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Foroword' 

Data-Based Program Modification (DBPM) is a systematic method of individualizing educational 
plans for children with any kind of learning or behavioral problem. It had its origins in a 
Special Projects grar.c to the University 6f Minnesota in 1971 in which, in collaboration with the 
Minneapolis Public Schools, an individual program modification system was developed to enable 
Special Education Resource Teachers' (SERTs) to work with regular education teachers to maintain 
handicapped children in mainstream classrooms. ..Since then, the University of Minnesota has been ' 
training SERTs for service in public schools, and Stan Deno and Phyllis Mirkin have been teaching- ' 
them the principles and procedures of DBPM. The present state of DBPM owes a great deal to the ' 
feedback provided by SERTs .out of thei r on-the-job experiences. 

The dissemination of this manual has been undertaken _as part of the training and support' 
activities of the Leadership Training Insti tute/Spefial Education. Since its initial authorization 
in 1968 under the Education Professions Development jAct, the LTI/SE has functioned as a support 
■system for training projects that focus on enlarging the capabilities of both regular and special ^ 
education teachers to serve handicapped children wiihin as normal environments as possible, and 
for projects-developing instructional materials for} training such teachers. As part of its 
support system activities, the LTI/SE has assisted " 
reports and other materials that deserve the attent 
commercial publishers. ' • , 

« In 1972; for example, the LTI/SE made available for national distribution to special educators 
and special education teacher-training programs Instructional Alternatives foi^xceo4^ona-k 
Children (E. N. Deno, Editor), the reports of some'-'pToj^^^sLV'^^t^rbrEPDA'^or 8ur?;u''of Edu- 
cation for the Handicapped funds to explore new roles for sp^Val education teachers. In the same 
way, in 197't, the LTI/SE assisted in the dissemination of Instructional Development for Training ' 
Jeachersof Except iona 1 • Chi 1 dren (S. Ti,iagarajan, D. S. Semmel, £ M. I. Semmel), a -sourcebook of 
ideas and procedures for the development of instructional materials for teacher preparation- 
programs, a project of the Center for Innovation in Teaching the Handicapped at Indiana University 
Other dissemination activities of LTI/SE have focused on the integration of handicapped children" in 
mainstream classrooms and the development of wi thi n-school skills and materials to make the inte- 
gration work. (For the bibliographic information on these and other LTI/SE publications, see the 
listing at the end of this book.) 

-Like other programmatic instructional materials disseminated by LTI/SE, Data-B.-?sed Program . 
Modification is geared to implementing P.L. 3k-\lt2., In addition to detailing procedures for 



relevant projects in the dissemination of 
ion of colleagues but are too special ized* for 



writing and evaluating individual education plans, DBPM systematizes^rocedures to involve parents/ 
guardians and/or pupils in the marking of educational decisions, that aff,ect the pupils' lives. 
Indeed, few instruct ionalprograms follow the provisions of P,L. 9^-1^2 as closely as OBPM. 

Stan Deno has had a long association with the LTl/SE in a training and support role.* When the 
LTI was functioning as a support syfetem for EPDA and Teacher Corps projects, Deno was a highly 
valued consultant in the field to projects testing new ways of closing the gap between special and / 
regular education and exploring new roles for special educators. Phyllis Mirkin,*a doctoral can- / 
didate as of this writing, spends a considerable anx>unt of her professional time in conducting / 
workshops for special education teachers on Data-based Program Modification. /. 

I am very proud to be able to present Data-Based Program Modification to our special educati9n 
colleagues in the schools and preparation ceirters. v' ^ 

^ , Maynard C. Reynolds,-Directo.r 

< Leadership Training Institute/ 

Special Edu'ition 
University of Minnesota 
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:* } ORGANIZATION OF BOOK 

This presentation of Data-Based Program Modification (DBPM) has seven ; 
parts. Part I contains three chapters oJE introductory material: (a) the 
rationale for the use of DBPM, to develop programs for students ;who are 
identified as having learning problems; (b) tHe contextual framework for 
DBPM; and (c) the measurement procedures that are basic to DBPM. 

The core of DBPM is presented in Parts It-VI. In them there are detailed 
the specific; step-by-step ppcedures for carrying cut DBPM. 

Paift II (Chapters IV-VI) covers the specific sequence of activities in 
-the initial assessment phase: (a) communicating and- collaborating with 
'teachers, parents, . other professionals, and students to ""identify the pro- 
blems which are the basis of the referral; (b) measuring student progress and 
performance on specif ic ^tasksj and (c) evaluating the results of these pro- 
cedures. , , 

Part III (Chapter VII)- continues the sequence of activities during program 
planning. 

Part IV (Chapter VIII), rart V (Chapter IX), and%art .VI (Chapter X) 
cover, in succession, the program implementation, program adjustment, and j 
program certification activities of DBPM. 

Part VII (Chapter XI) concentrates on consultation' and training, 
activities in which the Special Education, Resource Teacher assumes an indirect 
service role. | 

A feature of the. Manual is the application of the principles of DBPM 
to the case of a hypothetical child with a number of learnitig and behavior 
problems. Thus, >the materials that are used to gather data, make decisions, 
and communicate wit., teachers and parents are presented as if for an actual 
student. The materials also suggest the kinds of information which can be 
generated with DBPM. 

V 

Many of the forms and materials, especially those in Chapter III and Appen- 
dix B, may be reproduced. However, they need not be used exactly as illustrated 
for DBPM to work. Because DBPM is first and foremost a set of principles 
and procedures, we encourage each person to adapt the procedures and fo'rms 
to the specifics of each particular school environment. ^ ^ 

Due to the limitations of publication all the graphs in this manual are drawn 
in one color. Normally, in practice, the different symbols and' lines would be 
drawn in colors. To avoid confusion in the presented graphs trend lines have been 
omitted. . 
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PART I 



Introduction to 
Data-Based Program i^lodificat ion 




Chapter. I 



THE CONTEXTUAL FRAMEWORK 



Classroom teachers today are being required to assume responsibility for serving children 
with a broader range of individual differences than at any period since the one-room school. This 
mandate is based on court decisions, in which there is clearly stated the social philosophy that 
the first priority of educatipn Is individual enhancement rather than societal convenience. Where 
^educational placements were„ once made to serve the majority interests, placements now must be. made 
to serve the_needs of the individual student. ^ . • ^ 

The changes demanded of the schools and teachers under this new philosophy "are large but 
not insurifiountable. Most teachers have been long aware of the heterogeneity^ of even a so-called 
homogeneo^l'^assroom group, and they recognize the need to adapt educational methods and mater- 
ials to the Individual learner, if on a limited scale. The increased range of behavioral dif- 
ference in the classrooms which has bgen brought about by judicial mandates! has simply served to 
make it even qlearer that providing an appropriate education for the Individual necessitates ' 
tailoring or custom fitting programsr to a degree not presently accomplished^ in the schools. 

To help classroom teachers meet this new responsibility, an increased dumber of mbdels or 
systems for individualizing Instruction have been advanced by prof essional ^educators, especially 
those identified with special education. Special educators have becpme particularly concerned ' 
with individualization because, unlike their general education colleagues, they always have 
concentrated oh the individual problems of the children who have been referred out of normal 
educational programs. Yet, no method or system of individualized programing now available is 
adequate for all children, in all classroom settings, and 'under all circumstances. No wonder 
so. many teachers currently 'fn service and in training have become suspicious^ of the grandiose 
claims often made fojr "individualization"! 

.Data-Based Program Modification "(DBPM) is not offered as a solutioh to all educational 
problems. What is offered, instead, is the set of procedures making up DBPM which provide the 

0 

means of evaluating alternative solutions to the learning problems of most student^ encountering 
school difficulties. When implemented, the procedures provide valuable 4:ools for the resolution 
of problems thdt face teachers as they try to modify instruction for children who have not pre- . 
^yiously been appropriately served in prevailing educational programs. The procedures have been 
aeveJ.oped In large part out of the actual experiences of many teachers in a number of schools ii) 
and around the Minneapolis-St. Paul (Minn.) metropolitan area who exchanged their traditional 
role of special teacher in a self-contained classroom for one of resource teacher to exceptional 
children in. regular .school classrooms. By making this book available throughout the country, the 
authors hope that the DBPM procedures will aid educators who are searching for more effective 
Institutional programs for children with diverse needs in the regular classroom. 



16 



\ 



~ ' Social and Legal Background: 

The Judicial Mandates 

The persons we have usually grouped together under the-ea^gory-tebels of\exceptional" and 
"handicapped" clearly have one characteristic in conunon^he'ir'^behavior deviates significantly 
from normative development. Behavioral deviation created stress in the schools because educational 
programs were organized around normative development. The sociologist, Jane Mercer (note 1), 
pointed out that societies usually adopt at least one of three strategies for coping with deviance: 
- (a) "exclusionor exemption"]; (b) "deviate status placement"; or (c) "intensification of social- 
ization." 

The first strategy, exclusion, deprives the exceptional individual of all status within 
the group because, by definition, he does not meet group norms. Thus, the process of exclusion 
' t places the Individual outside the group and makes -him an alien. 

Tfie second strategy, deviate status placement, occurs, when exceptional persons are allowed 
to stay withirf the social system but are assigned a special status and role expectations that are 
quite different from the ordinary. Since the expectations are dif f erent, " the status Is not so 
highly valued by mem'bers of the society and, therefore* the deviate stattis tends to be stigmatiz- 
* ing. ' , " ' 

-.he th^rd' strategy, intensification of socialization^ occurs when a society tries to "norm- 
alize" the "^exceptional person's behavi6r through education); rehabilitation, and therapy. When 
addpted, this intensification strategy implies that the individual, although a deviate. Is still 
a group member and the expectations held for him are basically ordinary. > ■ '\ 

'^^^ history of educational programs for the children described as exceptional or handicapped • 
essentially parallels the three, strategies identified by Mercer. Prior to the X870s the response 
o^ the public schools to what were sometimes called "wretched unfortunate^" was to exclude Chem - 
entirely from the educational process. With the advent of compulsory school attendance lawsi the 
strategy of exclusion was changed to deviate status placement. A continuum of special status was 
created for children of "filthy or vicious habits." Initially, deaf, blind, or physically handi- 
capped children were instititionalized in 24-hour schools where they could be isolated from the 
normal community. Between 1920 and 1960, as a result of external pressures, special uay schools 
and special classes for "misfits" of^^any kind were developed within communities until, by the 
19505 3ven children whose development was so retarded that the^ were given the label "trainable" 
began to participate in special classes in public school programs. 

It is well to reftrember that' the development of public school programs for deviate status 
individuals has occurred essentially as a result of Special legislation to j^upport special pro- 
I grams for the children who are identified as "handica^pfed" or '^'exceptional" by the laws. Yet 

the public\financing for such programs is still based essentially on deviate status placement in 
. that the children declared eligible for special education services must first be labeled learning 
disabled, emotionally disturbed, mentally retarded, deaf, blind, or physically, handicapped. 

The most siknificant recent developments in the education of exceptional children have occurr- 
ed through the ciurts. Beginning with Diana v. State Board of Education (1970) and proceeding 
through a series bf subsequent court decisions, the right to equal educational opportunity (usual- 
ly called the right to education) has been extended to all handicapped persons, regardless of 
level of developmeht. (For a concise discussion of the origins of the judicial determination of 
. the right to education, see Gllhool, 1976.) This right has come to mean that even persons who 
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are bedridden and who formerly , received only health-care maintenance now must be provided with 
state-supported instructionXif only to enhance their life skills. ^\ 

^ The right to education litigation has been based on the Fourteenth Amendment, which provides 
equal rights under the Cons ti^tut ion The extension of equal educational opportunity to even\l^e 
most profoundly handicapped <|'hildren, however, was influenced by more than social ethics. Much 
of the testimony brought to bear on these^4ecisions related to whether all children could, in ' 
fact, benefit from education. The, favorable cqurt decisions might not have been enunciated were 
it not for the fact that many patient and understanding teachers have demonstrated that all child- 
ren 'are teachable. Without these demonstrations it mi,ght have been possible to argue that the 
right to education, with its implication of the ability ^to learn, does not apply to handicapped 
persons. Sufficient evidence has been provided, however,^ persuade the courts that all persons, 
regardless of the magnitude of their disabilities, can profit ^rom training and, therefore, all 
persons have the right to publicly supported 'education. \ 

Normalization Principle , - \^ 

The right to education decisions have led to a second order or deriva^e^legal principle 
influencing current educational. programing for handicapped persons— the doctrine' oi least restrict- 
ive alternative. This doctrine states, essentially, that the 'educational programs provided for 
all (handicapped) pupils must be the least restrictive of the range of choices or op tionSs avail- 
able. The doctrine is intended to prevent schools^ frpm using exclusion or deviate status ^ace- 
ment as routine strategies in the education of handicapped children unless such strategies prove^ 
to restrict the opportunities available to them the least. The assumption is that unless a suffi- 
cient case can'4)e made for an alternative educational setting, the least restrictive envfronment 
for the individual and, 'therefore, the one in which he belongs, is the modal educational program. 
For the large majority of handicapped children this modal program is the regular Classroom— the - 
mainstream. 

Any alternative to the educational :nainstream must be shown to be in the beSt^^interests of 
the individual before he is placed. To insure that the student's best interests are met, schools 
are required to observe due process under the law whe^never a placement out of the modal program is 
contemplated. In addition, should the student's parents or guardians/believe that a program change 
does not best serve the cjiild, they have the right to call for a due process hearing and to have 
Xegar representation?' it is important to emphasise at this point that tutoring in resource rooms 
constitutes a program change which a parent has the right^ to challenge. 

As the courts have moved t*o clarify and protect individual rights within education, educators 
have, In Mercer's words, "intensified their efforts to socialize" (note 1, p. 1) rather than to 
reject or label individuals'. This effort. has become known as the '^normalization principle" (Nirje. 
1969) . As applied to educational programs, the principle holds that every effort must be made to 
normalize educational environments and behaviors for exceptional persons. The application of this 
principle in educational organization is considered in the following section. 

Implications of Court Decisions *" « ' \* 

The right to equal educational opportunity and the doctrine of least restrictive alternative 
are fundamental educational principles. They have become integral to program organization and 
policy within local school sy^steins and are implemented through what educators call "normalization" 
and "mains tr earning." Where "normal" children once were served in regular education programs and 
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"handicapped" children ^^in segregated (separate and theoretically equal) special education pro- 
grams, it is now the policy to serve all children through a continuum of alternatives 



for Exceptional Children' (CEO) adopted as a pa::t of its policy statement, 
Special Education Service Model" (Fig. I-l.). 



The Council 
in 1971, the "Cascade of 



Level I 



level 2 



Level 3 



Level 4 



Level 5 



Level 6 



Level 7 



Exceptional children in regular classes, wjth 
or without supportive sfervices ^ / 



Regular class attendance plus supplementary ^ 
instructional services 




/ 



Part time 
special class 



Homebound 




Full time 
special class' 

Special stations*//// 

Assignment of pupils to 
^settings governed primarily 
by the school system 



Instruction / 
in hospital, 
residential, or 
total care setti 




Assijgnnient of Individuals 
" to the settings governed 
primarily by health, 
correctional, welfare, 
or other agencies 



Fig. i-l. 



* Special schools in publif school systems 

on service. Source: "Special Education 



The cascade system of special educa'tion bervice. source: "bpeciai Educati 
a6 Developmental CapitaP\by E . N . bene. Exceptional Children, 1970, 3743) 
229"237, 235. Copyrighted ixy The Council for Exceptional Children. 

/ * ' / ' ' ' ' ' 

^e Cascade of ^ervices Model provides local school districts with a framework to organize 

alternative administrative options for each handicapped pupil and to make t,he appropriate place- 
ment decisibi^ for each. The tapered shape of the ;nodfel ref lects^ the decreasing number or propor- 
tion of children ^o are served in the different placements. The right to education and doctrine 
of least^ restrictive .alternative are illustrated by ^he arrows governing, movement or placement 
decisions down and' up theCascade. Movement out of/ the regular classroom (down the Casc^dp) is 
usually considered to deperul ^the severity of an /individual's handicapping c^^ition. / 

Consistent with CEC policy, state education aj^encies have begun to adopt the Cascade or some 
version thereof ; and considerable effort^ has beqn directed toward moving students, previously 
segregated into levels 4-7 of the model, into levels of service more closiely approximating norm-* 



ality. For the children at level 7,^ this mo\^ement has been characterized by both deinstitutioii-^, 
alization (the creation of community alternatives)^and the assumption of educational responsibility 
within necessary institutions by local school systemsv^ For children at levels 2, 3, and 4, the 
movement to normalize educational environments has created^^the need for better articulation 



mechanisms between vregular and special education which allow fre^r-and less Life -disrupting move- 
mnt along the continuum of alternatives. A major problem, however, is that virtually all states 
require by law that before' special education monies may be used to provide an appropriate program 
for a student, the student be given a handicap label. In effect, then, the legislation rewards 
school systems (virh special education mbnies) for finding and labeling children as exceptional. 

With or without incentives, the schools have had no difficulty in labeling some' children as 
deviant. For, example, Rubin and Balow (1971), in their educational follow-up studies of 1240 
children without overt handicapping conditions, found that by the fourth grade, W. of their, sample 
already had been identified as deviantVenough to warrant some form of intervention, and 24% had 
received some special education services. More recently, they discovered in their longitudinal"" 
data that by the time each pupil had been rated by four different classroom teachers, over half of 
the girls and about three-fourths of /the boys had been rated as behavior problems by one or more 
of the teachers (Rubin, note 2). * " 

Implications of Policy for Inst ruction i 

, Current organizatioTial patterns ,and policy in special education contain at least the follow- ' 
ing implications for the instruction of handicapped children: 



Imperatives 

1. The program goals for all students, re- 
gardless of the nature of their , handicaps, 
must be derived from an analysis of those 
'behaviors that ar;e necessary tp function in 
a less' restrictive environment. 



Implications 

In a practical sense, this imperative 
means that teachers at any level of the Cas- 
cade should determine t;he.^ behaviors that are 
necessary for the children to function-^at the 
next higher JLevel, and they should direct their 
instruction toward those behaviors. To do so 
at level 2, for example, would eliminate the 
setting of auditory and visual processing 
tasks as educational objectives unless the 
value of the tasks for level 1 performance 
could ^ be demonstrated. 



2. Placement of a pupil in an educational set- 
ting should be determined by his present reper- 
tdire of behaviors rather than his diagnostic 
label (e.g., learning disabled, dyslexic, min- 
imally brain damaged, .neurologically ir.paired, 
emotionally disturbed) » 



I. 



Present assumptions are that labels may 
be necessary to iustify the use of program 
resources but t?ot, generally, to make, instruc- 
tional program decisions. Further, it is gen- 
erally believed' that labeling has had detri- 
mental effects on individual development; for 
that reason alone they should be avoided. 



3. The success of .instructional programs 
should be based on the rate at which the pro- 
gram moves the pupil toward functioning in more 
normal environments. - 



At the level of instruction, this impera- 
tive means that evidence must be presented that 
the pupil is making progress along a sequence 
of approximation^ to normality. If a "special" 
education program cannot demonstrably improve 
a child's rate of development, it is indefens- 
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ible as a service. We are critical of defining 
quality of service in terras of time, program, 
or teacher-pupil ratio. 



4. Whenever possible, special educational ser- In effect, this imperative means that 

vices for handicapped students should revision in either instructional objectives 

brought to the individual rather than bringing or instructional treatments should occur with- 

the individual to the sen^ices. in the natural environment (i.e., home, school, 

and community) rather than in one that is for- 
eign to the child (i.e., special class, school, 
or residential center). In practical terms, 
this imperative has produced the need to re- 
train regular school personnel so that they 
' ^ ' can individualize instructional programs and, 

- - thereby, increase classroom tolerance for be- 
/ * , havioral diversity. 

The policy -iss.ues in the education of handicapped children are, with the help of the courts, 
becoming clearer, and the implications *of the issues fgr^the administrative organization of edu- 
cational ^programs cap^be identifed. The problem that remains, in fact, is to creat-e educational 
programs, that effectively produce the greater inclusion of persons into the mainstream of our 
society: In ::reating educational program^ for including handicapped students, we must be mindful 
of the lessons already learned in other integration attempts! Effective programs are defined not 
in terms of their procedur es but, rather, of their outcomes . Jflacing student^ with skill deficien- 
cies in more normal settings means nothing unless the placement enhances their development and has i 
positive affects on the behavior of the peers with whom they must interact. In addition, the real- 
ity is that, general eaiiviation&l 'programs, regardless or attempts to individualize them, will 
always be unable to provide an appropriate education for some proportion of childr^jn. 

While the implications of social policy and legal responsibilities in serving exceptional 
individuals have become clear, what is not so clear is how these policies should be operational- 
ized. How do we bring specialized services to childijen who require them in a way that protects . 
h^etx rights? / ^' . ^ 

The procedures presented in this jnaniiaX represent an attempt to operat^onalize both social 
policy and legal reponpibility. Appropriate application of the procedures requires an understand- 
ing of the assumption^' upon which DBPM is based. 

Basic Assumptions of Data-Based Program >Modification 

Five assumptions constitute the basis for DBPM, Although DBPM is advanced as, a way of 
developing program modifications for handicapped students, its procedures are equally applicable 
tp all children's programs, of course. 
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ASSUMPTION SI 



At the present time we are unable to prescribe specific and effective 
changes in instruction for individual pupils with certainty.. Therefore, 
changes in instructional programs which are arranged for an individual, 
child can be treated only as hypotheses which niust be empirically tested 
before a decision can be made on whether they are effective for that child. 



Two. factors strongly influence this assumpcion: 

1. A substantial and growing body of literature is addressing the difficulties encountered 
when differential diagnosis is used as the basis for program prescription (Quay, }V3; Ysseldyke & 
Salvia, 197A). At the heart of differential diagnosis or 'Miagnostic-prv^scriptive instruction,'* 
as it is popularly called, is the premise that it is possible to measure a child's abilities by 
Msing a battery of highly specific standardised tests and then, on the basis of these test re- 
sults---the diffex^ential diagnosis— to prescribe a program that' is more likely to be successful for 
the child than a program designed without such diagnostic Information, This premise is false. If 
one acts ao though it were tru^, one is following Campbell and Stanley's (1963) "trapped 
administrator" who introduces a reform as if it were certain to be successful when the probability 
of success is unknown, Jn fact. /Ysseldyke and Salvia (1974) concluded that the empirical techno- 
logical basis for such diagnostic-prescript4.vo procedures, as they are cy«iimonly advocated and 
practiced, is so inadequate thaT^he^ childr'ejj subjected to them are, in effect, invqluntArlly 
participating in uncontrolled experiments. ^ 

- 2. It is becoming increasingly evident that a methodological error is committed when 
measurement and prediction procedures, 'wMch, at best, are on-ly modestly accurate for groups, are 
applied to the prediction of individual perfortnance. For example, by collecting statistics over 
thi' years, the National Safety Count^il is able to predict with a fair degree of accuracy the num« 
bei of deaths that wiil occur on the nation's highways over a given holiday; it "would be a misuse 
of the data, of course, to trj; to predict ^the identities of the victims. In the same way, achieve- 
ment can be predicted from aptitudfe test data fairly accurately for groups but distressingly in- 



accurately for individual^. 

The point is easily appreciated by the experienced teacher who has had many opportunities to 
observe that what may work with ^^ome members of a group will not work for others, and that it is 
_aQi^^alwaysH)os&iin¥=^F^RT^^ children will benefit and whi^h will not. Prediction is always 
poorer when the lirediction is ijiade for one -case. 

The inevatable conclusion to be drawn is that with our present l-s?el of knowledge about the 
kind of instruction that should be provided a child who posseses a given set of aptitudes (or 
traits), and the current capability of our technology to make individually accurate predict ions^_ 
we are in the same position as pharmacists who selX ov^r-t he-counter medications without knowing 
whether they will benefit the customers who take them. The reality of all political, social, and 
educational reforms is that their effects are hypothesized rather than known; thus they should be 
treated as hypotheses ("hunrches") whose effects must be measured and evaluated. In Campbell's 
(1969) words, we should treat our "reforms as expei'imerts. " 
ASSUMPTION ^1 
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Time series research designs are uniquely appropriate for testing instruc- 
tional re forms (hypothei^es) which are intended to improve individual performance 

;■ ~^ 22 



12 



By definition, "A time series is a set of data ordered in time, typically observations made 
at "regular intervals" (Tintner, 1968, 26, p. A7). Perhaps nothing better characterizes the kind 
of data a teacher collects than the definition of a time series. What is a sensitive teacher doing 
if not observing his/her student each day and making changes in instruction based on these regular 
observations? vmat teachers typically do not do, however, is to observewith order and precision, 
which permit valid conclusions to be drawn about the relation between instructional changes and 
students' responses <achievements) . The unfortunate consequence of this Iqck of order and precis- 
ion, is that teachers develop what B.F. Skinner called "superstitious behavior." 

Superstitious behavior is behavior that occurs frequently because it has been followed 
accidentally by a desirable (reinforcing) event. The adverb "accidentally" indicates that the 
desirable event was not the outcome of (not "produced" by) the Jbehavior bXit, instead, a coincident- 
al sequel to the behavior in time, thus making it seem that the behavior produced the desirable 
event. Such accidental occurrences produce increases in behavior just as surely as true (non- 
accidental) consequences. In the laboratory, this phenomenon is exemplified by the pigeon that 
learns to bow or turn in a circle when given food, although the tbod is delivered every 15 
seconds regardless of what the pigeon is doing. A social example is the rituals enacted by pro- 
fessional athletes. Coaches have been known to wear the same pair, of socks without washing them so 
long-as their teams win; jnost of us, however, see the relation between dirty socks and winning as 
purely accidental! > , ' , 

, How does the unsystematic and imprecise observation of student performance a'nd frequent in- 
structionj^l changes in relation to that performance result in superstitious behavior in* teachers? 
If the discussion to this point has been clear, you know the answer. Since char>ges in student 
behavior (usually but not always achievement of academic skills) are important desirable outcomes 
for teachers, the occurrence of the changes after any. teaching activity is likely to result in an 
increase in that activity, whether or not the teaching activity produced the behavior changeel 
Let us look at a hypothetical case (which is not so hypothetical in many classrooms). 
• The teacher institutes a program of reading instruction for a cliild with^visual weaknesses 

who is two years below grade level. The program has been developed l:o capitalize upon the child's 
auditor/ strengths and de-eraphasize his visual weaknesses (e.g., decoding-encoding emphasis). To 
^ implement this program, the child is removed from his regular reading group and is tutored, in- 
stead, by the resource teacher. After six months, the child is tested in reading and is found to 

I have advanced one year. The teacher considers this result to be evidence that the auditory pro^ 

gram is highly effective. Not only does the teacher continue to use the program with the child 
but, very likely, with "similar" children as well. In fact, the teacher 'probably shares tlie 
knowledge with colleagues. 

Is this teacher engaging in superstitious behavior? The answer is "no" if the auditory 
program alone actually produced the change in "the child's achievemnt. The answer is "/es" if 
the improved achievement was the outcome of other aspects of the program, such as the individual 
instruction or increased practice in reading, and appeared coincidentally following instruction 
in the auditory program. Many teachers who routinely award tokens to children never know whether 
the instructional program or theapkens are responsible for the children's progress. 

Given the large number of academic and social behavior changes curring routinely in the 
school, it is safe to assume that many are coincidental to different teacher behaviors, but these 
coincidental occurrences result in superstitious teaching behavior unless the teachers impose order 
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and precision on their work. ' ^\ . 

What order and precision is required? The details are discussed completely in the remainder 
of this boots but some introduction can be provided h-re. (a) Order can be imposed on the process 
of observation if the teacher structures the sequence of changes in instruction so that reliable 
and valid information can be obtained, (b) Precision is obtained by observing the child* s be- 
havior during each change and converting this record into numbers. When changes in instruction 
are introduced in such an orderly manner, their effects can be interpreted through the examination 
of the numerical data. When order and precision are imposed on teaching activities, a time 
series experiment is created enabling systematic tests of plausible instructional hypotheses on 
how best to help a child develop. It should be evident that treating teaching like time series ^ 
experiments reduces the likelihood of developing superstitious behavior and increases the likeli- 
hood thit an effective instructional program will, be cumulatively constructed from hypotheses that 
are- empirically verified. 

ASSUMPTION 8 5' 



Special education is an intervention system, created to produce reforms 
in the educational progr^s of selected individuals, which can (and, now, 
with due process requirements, must) be empirically tested. 



All oe us have experienced the ill effects of social institutions or programs that were 
designed to work to our benefit. To sue a physician who, presbraably, has applied his skills 
to healing would be unthinkable were' it not for the evidence that physicians sometimes engage 

^" malpractices for which they" must be held accountable. The story. One Flew over the CuckooV * 

Nest ClC^sey, 1962), sensitized us to the potential abuses of patients in state hospitals. And. 
.\ ^we ^Ava^epome distressingly aware of the mistreatment of minorities by all social institutions, 
including our schools. ' ' - 

; In 1968, Lloyd Dunn pointed out that research on special class placement of mildly retar<fed 
pupils indicated that such placement is as likely to decrease as increase the educational 
achievement of children so placed. Earlier in this chapter we briefly traced the history of 
education, for exceptional children and tried to show' that education for exceptional persons has 
_been_^ducted asjnuqh (if not more) to suit the convenience of the majority as to benefit the 
..individual. With the passage of P. 94-142,^ which requires states to develop due process pro- ^ 
tectibns for children in school, we have arrived at the point where we must demonstrate that 
reforms in the instruction provided for youngsters are of demonstrable benefit or we must 
halt them. 

The arguments supporting assumptions i?l and n establish that we cannot know in advance 
whether a specific reform will, in fact, benefit a child, and that the best methodology currently 
available for empirically verifying instructional hypotheses is the time series design. *The 
implication we draw from the presented facts is that we are obliged to apply time series research 
designs to evaluate the effects of special education services provided for every pupil. (Chapter 
III is ^largely devoted to the procedures of applying time series da%a analysis to special educa- 
't ion programing.) 
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ASSUMPTION ««♦ 



To apply time series designs to (special) educational reforms we need 
to specify the data representing the ".vital signs" of educational devel- 
opment which can be routinely (frequently) obtained in and out of school. 
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To most of us, it is unthinkable that medical treatments not be tailored in response to our 
"vital signs" (i.e., heart rate, blood pressure, temperature, etc.). Modical practice is largely 
based upon routj.ne measures which are so simple to administer that most of us can and do appraise 
our own health with some precision. What are the "vital *signs" of educational "health"? What 
measures do teachers routinely administer to check the development of their sf * 'snts? 

Regrettably, the routine measurement of performance is not a common practice in the schools. 
The best that we usually have to offer is testing at the end of a unit of instruction for grading 
purposes. More often, in the elementary grades, teachers estimate a child's current level of 
development in a subject like rending by referring to the. instructional group (high, middle, or 
low) the child is in, whether the group. is "on grade level," and whether the child is' "doing fine" 
'-or "needs improvement." Such^ imprecise estimates can be called "measures" in only the grossest 
sbnse of the word: 

Worse, little or no agreement exists regarding the performances that index growth in critical 
curricular areas like reading, written language, and math. General agreement exists that the 
purpose^of reading is "comprehension," but at the present time, no operational definition of the 
term "comprehension" is agreeable to even a modest proportion of experts in reading. In math- 
ematics, most teachers sp^end a great deal of time on basic computational skills, and the "return 
to the basics" movement has been given impetus by falling scores on college entrance tests. At 
the same time, prominent curriculum experts decry the overemphasis on computation at the expense 
of conceptual. development . 

Our response to these problems is twofold: 

1. We concur that no universally accepted or used "vital signs" have been established in 
any area of educational development and that, for the present, what is critical for exceptional 
persons is to develop those behaviors that are necessary for them to 'function in the environments^ 
to which they (or their parents or guardians) aspire. (This point was made earlier as Assumption 
n.) Defined in this way, exceptionality always will refer to the^ difference between a.personVs 
performance and the cultural expectations for performance on a culturally relevant task. From 
this viewpoint, "vital signs" are always culturally relative; their identification requires the 
specification of (a) the culture or social setting in which the individual is to function (i.e., 
classroom, school, neighborhood, etc.); (b) the tasks and their relative importance; and (c) who 
decides what is acceptable performance ^on those tasks. With this information in hand, it shoulcT 
be possible to develop a system for routinely monitoring performance on vital signs which is at 
least functional for building and evaluating educational reforms. When more generally agreed upon 
vital signs are developed, we believe the same general approach can -be used. 

2. We suggest that the quantitative index of "health" consists of the relative difference 
between the individual's level of performance and the -performance which is desired from individ- 
uals within the culture. V.e have called this relative difference the "discrepancy ratio." (Pro- 
cedures for computing such ratios are introduced in Chapter III and detailed in subsequent chap- 
ters.) The discrepancy ratio is useful because it allows for fairly precise comparisons of 
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discrepancies across all academic and social! tasks deemed "vital" by a culture, regardless of 
age or level of performance. We suspect that some form pf discrepancy ratio, in the long run, 
may be more useful in making decisions about who is eligible for special education services than 
the test information that is currently used, 

*^0P<^ ^^^t the eventual outcome of the search for measurable '^ital signs" will be to 

place in the hands of teachers and parents the equivalent of good "thermometers" which they can 
use more frequently and clearly to index children'^s educational progress-^an outcome that is sure 
to raake all concerned persons more Vesponsive to the. immediate needs of Che child. 
ASSUMPTION §5 



Testing program modifications (reforms) requires well-trained profession^ 
als capable of using time series data analysis to draw valid conclusions 
about program effects. - ^ 



A key to resolving the countei:acting forces of Exclusion and inclusion in education is the 
availability of highly skilled professionals at the point of articulation between modal (general) 
education programs and special educational support. Cpmpetent professionals at this point can 
provide support to the general educator as well as pr6tection for the rights of exceptional 
children. At the University of Minnesota, for exarapl^V these professionals are called Special 
Education Resource Teachers (SERTs); however, their role and functions arc more important than 
the title (Deno & Gross, 1V72). The role, under various titles, has emerged in a substantial 
number of states and programs across the United Sttites (E, Oeno, 1972). The SERT» ordinarily, 
is a school-based (rather than itinerant) teacher/consultant who is the first person to wW the 
regular class teacher turns when he recognizes that the modal program is not 'optimism for a 
child's continued personal-social or academic developmeat. The SERT. is a specialis^ who is 
capable of organizing and managing individual program modifications that at once meet the . 
requirements of due process and effect the improvement of individual development. This guarantee 
of both protection and success can be net only through the use of procedures for the continuous 
objective evaluation of programs and their impacts on individual chi3,dren* 

In response to the requirements for /?ue process specified in«P.L- 93-380 and 94-142 many 
state education agencies have proposed regulations that require that the educational assessment 
of a handicappe^a student be made primarily within the responsible school district; preferably 
at the school which the child attends; and, to the maxvnwi extent feaaible, by peV8on8 who will 
*javvy responsibility for implementing the instvuatiunal program fov the child. Regulations* such 
as these virtually demand the inclusion of ,:ho SERT role in every building. 

Several features of the role filled by the SERX are worth jtrophasizinfi inasmuch as the xole . 
places a heavy burdeh'on interpersonal and resource management skills and on cooperative planning 
and case management* 

1* SERTs are much njore heavily involved in the diagnostic pi^ocess than teachers usually are, 
and for that reason they mCist have knowledge of psychological or medical diagnostic procedures 
and social work evaluations and be skilled in formal and informal educational diagnoses, 

2. Since the .S;^T coordinate^ the assessment of the problem, msrshalls resources, commii? 
cates with staff, and'manages paraprofessionals, much more of his time must Ve reserved for 4 
activities instead of for .direct. instruction. (This point is difficult to establish with both 
SERTs and their colleagues.) . " " ' . 

3. SERTs are responsible for collaborative decision making. All program changes are 



considered with the* child and' the teacherf" Program modifications that involve separating .the 
child from the regular classroom must be reviewed and recommended by a building 
special services team. • (See P,L. 9A-iA20 

A. SERTs are involved in direct instruction primarily during initial assessment and the 
development of an effective program modification. , SERTs must be skilled in using alternative 
methods and materials to develop effective Instructional programs. The basis for making program 
decisions in DBPM is the information that is generated and recorded. It is inseparable from the 
instructional process rather* than an added-on evaluation requirement, such as that of pre- and * 
post-standardized testing. • , ^ , 

5. The pressure is, an4 always should be, on turning over direct instruction and management 
of an effective program to the child, the regular classroom teacher, a peer, or a paraprof essional. 
Thus the SERT is free to develop additional effective individualizations instead of being restrict- 
ed. to .a static caseload. ' o o ^ 

r 

6. The progress of handicapped children is monitored by SERTs. They are responsible for ^ 
charting the progress of all handicapped children on a regular basis, whether or not they are 
directly instructing the children themselves. Special education must be committed to insuring the 
children's success, not necessarily directing instruction. Regular and continuous monitoring 
of progress is the basis for e^^pi^hing this accountability. 

The skills r^uiredJfVr^ ftlnctiort^ng in the role of resource/consultant specialist^ (SERT) are 
the focus of this mandal. As we have noted previously, we call these skills, and the procedures 
of their implementation, Data-Based Program ModifioaH3n* 
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Chapter II 



THE CONCEPTUAL FRAMEWORK 



i 



The Model 



The concept-ual framework for the DBPM activities in which SERTs engage is an adaptation of 
the evaluation model which "was developed by the Center for the Study of Evaluation (CSE) (Klein, 
Fenstermacher & Aiken, 1971). This raod^; (Fig. II^l) describes fi^e dacision (decision-making). . 
areas and five concomitant program (data-gathering) phases through which developers move to 
improve program performance. Although, at first glance, the names of the model's elements may 
be onfamiliar to educators accustomed to other terminology; they are related to the common 
experience of teachers. Similarity can be seen between terms like "needs assessment" and "edu- 
cational diagnosis" or "program planning" and "lesson planning." 

V?hy have we introduced a new terminology (^r jargon) when the vocabulary already used by 
teachers to describe their activities is similar? Because the terminology of the model is based 
on a larger and more, general perspective of the processes of modifying children's programs. For 
example, the term "program modification," unlike a term like "instruction," emphasizeis the fact 
that some solutions to problems are not instructional (e..g.-,^ neg9tiating new a<^ministrative arrange- 
ments for a pupil or; modifying the program goals for a pupil), but are used rightly for part of 
the SERT's activities. - • ^ 

The model clearly identifies the decisions th^t educators must make in the process of creating* 
or modifying educational programs. Given the current emphasis on "due process" and the judicial" 



DECISIONS. AREA 




EVALUATION REQUI.REMENT 


PROBLEM 


SELECTION 




INITIAL NEEDS ASSESSMENT 


PROGRAM 


SELECTION 




PROGRAM PLANNING 

■» , 


PROGRAM 


operationalization' 




IMPLEMENTATION EVALUATION 
( INTERVENTION) 


PROGRAM 

> 


IMPROVEMENT 

> 




1 ^ 

PROGRESS EVALUATION 
(INTERVENTION) 


PROGRAM 


CERTIFICATION 




OUTCOME EVALUATION 

( NON I NTERVENT ION) ^ v 


Fig. Il-l 


Evaluation model used in data-based program modification. 
Adapted from "The Center's Chang ijng Evaluation Model" by 
S. K?ein, G. Fenstermacher, Aiken. Evalmtion , ^ 
Corment'j 1971, 2W\ 9-12. 
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? * * 

mandates underlying progressive integration (mainstreaming) , greater care must be given to devel- 
oping accountability for decision making in educational programing. We hope that educators will 
not become mired in legal proceedings, but they must become capable of documenting "who .made what 
decision^ and how those decisions were made." Furthermore, since the model is an evaluation 
njodel, it emphasizes the importance of data collection in decision making; at the same time, it 
makes clear that while decisions are (or* should be) based on data, decision making is separate 
from data collection and involves people and values as well as numbers, ' 

The application of the model Co the modification of an individual child's program generates 
(a) a set of specific decisions which must be made and (b) a set of activities which must be 
undertaken to provide the data base for the decisions. The decisions which must be made have been 
cast in thi* form of quefitions, and the activities which must be undertaken have been categorized 
as dif ferentrdata-gathering processes. 

Evaluation Requirements 

j 

Each decision area is addressed to answering a different question. Each program phase , is 
organized around the gathering of specific data that become the basis for making tjie related 
decision. Table II-l identifies the questions to be answered and the data to be gathered, during, 
each of the five program phases in relation to the five decision areas. 

We regard the information-gathering activities identified in^Table II-l as^ the responsibility, 
of the SERT, although it need not be. In contrast, the decisions which must be made are shared 
with the other persons who are responsible for a child's program. Thus, decision making is 
collaborative while data-collection activities are the primary responsibility of the special 
educator or a specified colleague. 

Additional Activities Related to the SERT Role 

In our preparation of personnel to function in the SERT role, we have been reminded that 
management of program modifications involves activities in addition to those listed in the CSE 
Evaluation Model. What has become obvious is the crucial role of successful communication and 
collaboration with other persons who are concerned with the identification and resolution of the 
problems (s), and the Importance of consultation and training in long-range efforts to integrate, 
exceptional children into regular classrooms. For that reasolT we have identified communication . 
and collaboration, on the one hand, and consultation and training, on the other, as major act- / 
iviH^s which are undertaken by SERTs as part of their DBPM functions. Adding these two activities 
to "measurement and evaluation" (the data-gathering processes) has resulted in the identification 
of four major processes that intersect with the five decision area/phases of the model. The four 
basic processes are the functional components of data-based program modification. They are^ listed 
in Table II-2 along with the focus and purposes of each process. 

Structure' . * * ' - 

The relation syf the four basic processes to tlie five program phases (and decision areas) can 
be seen by placing them in a two-dimensional matrix, as in Figure II-2. The resulting matrix 
contains 20 cells. Each cell identifies a process which must be carried out during a specific 
program phase. For each program phase, the specific process is^ translated into questions that 
the SERT attempts to answer. Wlien all the questions have been answered the program mo4ification 
for a student has been completed. 



\ Table II-l 



Data-Ba^ed .Program Modification: 
Program Decisions and bata-Gathering Processes 



Decision Area . (Question) 



Data-Gathering Process 



Problem Selection 

What are the problems that 
provided impetus for the 
referral and imply the 
need for program modifi- 
cation and special educa- 
tion service? 



Program Selection 

What program plan is likely 
to be least restrictive and 
yet effective in solving the 
referrer's problem(s)? 



Program Operational ization 

Is the agreed-upon program 
<"modi f i cat ion being imple- 
mented as planned? 



Program Improvement 

Does the program modification 
ars implemented appear to be 
moving us to problem solution? 



InV 



ial Needs Assessment: 



Determine who holds performance expectations for 
thk child, 

measure the current level and direction of the 
chilcHs performance, 

comput^the discrepancy ratio between' the per- 
formanc^ expectations in the chijd' s enviroa- 
ment and the child's actual level of performance, 
establish the importance rating (value) of the 
d i screpancyX 



Program Planning : 



\ 



2. 

3. 
k. 

5. 



Develop possible long- and short-range instruc- 
tional goals relatedXto discrepancy ratio, 
plan alternative instrqct ional strategies for 
achieving the goals, 

recommend alternative administrative arrangements, 
estimate time and resourcesx hecessary for attain- 
ing different goajs using different modi ficat ions , 
specify forces working for or\^gainst different 
modifications. 



Implementation Evaluation (Intervention)^ 



program 



2. 
3. 



Appraisediscrepancy between implementecls 
and planned program, \ 
ascertain reasons for discrepancy if one exi^sts, 
propose alternative ways to reduce discrepancy 
between 'planned and" implemented progfam., \ 



Progress Evaluation (Intervention) 



\ 



Appraise progress on short- and long-range objec- 
tives, ' > ^ 
propose alternative revisions for programs that, 
apparently, are not affecting performance greatly. 



Program Certification. 

Were the problem(s) solved 
through program modification 
(intervention)? 



Outcome Evaluation (Nonintervention) : 

1. Determine whether modifications have been success- 
ful in eliminating the discrepancies which led to 
initial referral . 
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' . " \ I. Table" 11-2 

Data-Based Program Modification: 
Four Basic Processes 

Process Focus 


.^Measurement, . , 


Student^ performance in relatipn'to current environ- 
ment: to provide an objective, precise, and quan- 
titative description (data) for use in evalucition. 


Eval uation 


Decision making: to relate measurement data to 
* values and people in making decisions during each 
program phase. 


Commuh i ca t i on . 
Col laborat ion 


Classroom teachers, parents, students, and Involved 

, professionals: to develop shared responsibility for' 

identification and selection; plaps fof service; 

program progress; and program outcomes**, 

f •. ^ 


Consul tat ion 
Tra i n i ng 


Regular class teachers, /aides, volunteers and peer 

and cross-age tutors: ^.to develop. Implement, and fr4 

manage data-based program modifications for an V 

individiial or group. » ^ ^ % ^-^^ 

k -A 



•v 



The particular^ questions which have been identified have 'evctlved out of using the matrix' 
to train SERTs and to help them develop their resource systems. The questions have been modi^ed 
many times and are likely to undergo f urthex!^ revision as the basic processes of DBPM are applicid 
to the decis-ions which inust be made during each phase of program modification. In the following 
chapters of this man-:aK the activities undertaken in each cell of the matrix to answer the 
requisite questions are set forth in detail. ^ 

The questions included in the matrix (Fig. II~2) are not exhaustive. In fact, we have in- *^ 
eluded only those questjions that highlight the activities essential to a particular cell. A 
more x:omplete set of qVes^tions to be answered,* materials needed, and action required to conduct 
DBPM are provided in Parts II-VI and in Appendix A. 

SERT Competency * • ' 

It is currently popular to identify what are referred to as teacher "competencies" when one 
describes what a teacher must be able to do to function in a given role. The term competency/ 
performance-based teacher education (C/PBTE) is widely u^ed to refer to training programs that 
are organized around what one i^ learning to do rather tdan topical content. Characteristically, 
in C/pBTE programs, training objectives are written in terms of th6se actions or performances 
which must be mastered in ordfer to complete training. We have not found it necessary to write out 
a set of performance objectives related to each question generated out of our matrix for the 
teachers with whom we have worked. With the materials provided in Appendix A, it would be 



• /decision 

/ AREA 

PROGRAM 
PHASE 


process: 

measurement^ 


/ 

t 

f 


EVALUATION 


COMMUNICATION 
. COLLABORATION 


CONSULTATION^ 
TRAINING X,^^ 


PROBLEM 
SELECTION 

INITIAL . 
ASSESSMENT 


1$ there a discreoancy between 
desired and actual performance ? 
•Arettiere desired performance 

expectations for academic and ^ 

social betiaviors? 

• Wtiat Is referred student's baseline 
progress / performance in these 
academic and social bejiavlors? 

• What is the discrepancy? 


Isthe student eligible for -service? 
•^^dve liTiponini oiscrepancies 
been identified? 

• Can a rationale be established for 
the imoorlance of the problem? 

• Does student meet eligibility 
requirements? 


Who owns th$ problem ? 

• Are the problems those the 
teacher; student: parent; 
others .identify? 

•Are they shared problems? 
•Should others be coftsulted? 

• What arc priorities? 


Can the SERT help or train others 

to select problems for program 

modification? * 

• Are there others who can be 
helped or trained to collect 
discrepancy data: conduct 
lnterviews:est"ablish priorities 
and eligibility for service? 


PROGRAM 
SELECTION 

PROGRAM 
PLANNING 


How will effectiveness of program 
plan b€ measured ? 

• What graphs will be kept? 

• How often will data be collected? 


What program plans are 
proposed ? 

• What-resources are available? 

• What discrepancies have been 
identified? 

•Wha\ objectives and program 
changes are proposed? 


Does the program plan meet the . 
expressed needs of the referrer. 
student, parent, and other 
»ntereste<* persons ? 
• Have all parlies been involved 
in planning? 


Can the SERT help or train others 

to select programs? 

•Are there others wfio can be 
helped or trained to propose 
atterriative programs: write 
objectives: determine 
measurement procedures? 


PROGRAM 

OPERATIONALIZATION 

IMPLEMENTATION 
EVALUATION 


Is program being implemented ? 
^ i> pcnurmdnLC Dcmg medsureo ( 
•Are pr'^ram changes being made? 

• Are graphs being kept for long\ 
rangeAJaily objectives? 

• Are program changes noted 
on graphs and is data plotted? 


Is program plan being implemented 
as proposed? 

• Are there a sufficient number > 
of data points for each inter- 

xvention? 

• Are program changes frequent 
, enougJi? 


Is program plan being implemented 
as expected by referrer. student, 
parent and rther interested persons? 

• Are all parlies aware of program 
modifications ? 

• Are all parlies satisfied? 


Can the SERT help or train.,others 
to operationalize program plans? 
•Are there others who can be 
helped or trained to implement 
program: measure performance- 
evaluate extent towHichprogramplan 
is being imptemented as proposed? 


* PROGRAM 
IMPROVEMENT 

* PROGRESS 
EVALUATION 


What information is available on 

nifnillsliuP nr/vir0C€ 1 narlftrrmn^a 

LuiHuieiivc (irugrc>> / pcnurnianLc 

to date? 

• Is there any information onjhe 
median level of performance/ 
average rate of progress for each 
intervention period? 

• Is there any information on 
trend and stability of perfor- . 
mance during each intervention? 


iC thp flmnrsm^SC tmAlamanlxwl nr/i 

1) iiic iiiw^idni n iinpieiTicnico prO" 

dyeing cumulative benefits for the 
studant ? ^ 
•Are there positive data trends? 
• Are there changes In discre- . 

pancies over initial assessment? 
•^Were some program changes 

more effective than others? 


Can information gathered j^n 
program changes be useful to 
others? . 

• Are all interested parties 
informed of progress? 

♦Will future program changes 
be recommended? 


Can the SERT help or train others 

to ipprove programs? 

*rAre there otners who can be 
helped or trained to evaluate 
progress: propose program 
changes: adjust programs?' 


PROGRAM 
CERTIFICATION' 

OUTCOME 
EVALUATION 


What is the present performance / 
progress discrepancy ? 

• What is the present trend of the 
data? 

• What are present discrepancy 
ratios? 


Should the program as presently 
planned be terminated ? 

• Has program 'been successful 
in achieving objectives?/ in 
reducing. discrepancies? 

• Can others assume program 
responsibility? 


Has program been successfi^l in 
satisfying the needs of alhnterested 
parlies ? * ^ - ^ 

• Are ail parlies aware of and 
satisfied with program outcome? 

• Do all parties feel program - 
should be terminated? 


Can the StRT helper train others to 
certify programs? 
•Are there others who can. be 
helped or trained to evaluate if 
xerogram should be terminated? 
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relatively easy (though tedious) to do so, however. 

In our work, we have taken the position that a SERT has satisfactorily completed training 
when he presents evidence of successful completion of at least six program modifications involving 
direct service for a target pupil, using the procedures outlined in the matrix. Additionally, 
the trainee is expected to present evidence of having consulted with and/or trained at least two 
other persons to implement the program modification sequence (see Part VII). Evidence is given 
, in the form^of case studies, which include graphed data. 



J^OECIS ION AREA: Problem Selection 



PROCESS: 

CO.MMUNICATION 
COLLABORATION 



MEASUREMENT 



PROGRAM PHASE: Initial Assessment 



EVALUATION 



Assess Expe^ 



^ Who 

owns the 
/ problem? 

»ett'at 



ions for Performance 

E 



I Referrer 



/ | Student 
I Parent I 
I ahers 



A T 

▼ Is there a 
discrepancy between 
desired and actual 
performance? 
-L 



Assess Actual Progress / Performance 
/Discrepancies 



Social Behavior | 



Academic Behavior 



1 — h 

Rate of 
Progress 




p- ■ 

Rate of 
Performance 


i 



Classroom / 
Observation/ 



Reading 
I 



Math 
X 



1 



— n 

Isttie 
student eMgible 
for service? ^ 



I Communication- | 
i ' 

jother Curriculum! 

I- 



♦ Have 
important discrepancies 
been identified? 

I 

YES 



► NO. 



Renegotiate with 
Referrer / Refer 
toother Sources 



Fig^ ll-3« Activity flow chart, by dfeCsjsion area and program phase, I. 



2A 



The Flow of Activities 

The specific sequence of activities in which the SERT engages when he develops a program mod- 
ification for an individual student (a case atudy) is shown^ in the successive flow charts (Figs* 
11-3, A» 5, 6, ^nd 7). Steps A, 8, 12, and 16, which are omitted from the charts,. because they are 
consultation and training procedures, are discussed in Chapter XI. 

The left-hand columns of the flow charts specify the oxder in which the matrix cells are imple- 
, mented* During the initial assessment phase, communication and collaboration always precede measure- 
ment and evaluation. Program planning begins with evaluation and is followed by measurement and 



DECISION AREA: Program Selection 



PROGRAM PHASE: Program Planning 



PROCESS: 
EVALUATION 



MEASUREMENT 



COMMUNICATION 
COLIT^BORATION 



^ What 
program plans 
are proposed? 



▼ What 
progress / performance 
discrepancies have 
been identified? 




♦ What 
program c^ianges 
are proposed? 




Specify Administrative Plan 



Specify Program Objective^. 

I 



Specify Program Changes 

TIT" 

effectiveness of 
program plan be 
measured? 

1 



Specify Measurement 
Procedures Tor Evaluating Plan 

1 — 



•NO- 



Adjust and 
renegotiate 
plan 



ERLC 



<'7 



♦ no?s 

y program plan 

satisfy concerned 
parties? 

I 

YES 

Fig. 11-^. Activity flow chart, by deci*sion area and program phase, ll< 
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communication and collaboration. Measurement, evaluation, and communication and collaboration 
each follow in order during the other three program phases. 

A general overview of the flow of tjiese activities follows: 

~ (Figure II-3) 



Decision Area: 
Problem Selection 



Program Phase:' 
Initial Assessment 



This phase typically" begins when a student is refered to the special education resource 
program by a Classroom teacher. The classroom teacher fills out a referral form on which the 
problems precipitating the referral are specified briefly and concisely, and the discrepancy b^^ 
tween student performance and classroom expectaEion is described. ^Procedures are initiated for 
the SERT to interview the teacher, parent, and studenc. Priority-ranking forms are completed and ^ 
specific academic and social behaviors are measured to establish an objective basis for definin.'^ 
the problems (s) specified in the^ referral. 

r 

If social and academic assessments are required, they are directed to specified areas of 
difficulty in the school curriculum rather than to generalized patterns of disability. The 

DECISION AREA: Program pperationalization PROGRAM PHASE: Implementation Evaluation 

Implement Program Plan|^-^ 



PROCESS: 
MEASUREMENT 



EVALUATION 



COMMUNICATION 
COLLABORATION 



I 



Measure Performance/ 
Progress as Planned 



i — 



Make 

Program Changes 

r 



[ Count Graphs H 
^ 1 



Count. Data Points { 





1 ' 


1 Count Changes | 


. 1 


1 



10 

11 



^ Is program being 

implemented? — ^ 
and is performance 
being measured? 

I 

YES 

♦ i 

program plan 
being implemented 
as proposed and expected? 

I 

YES 



•NO— ■ 



NO 



NO - 



Adjust 
Plan 



Continue Program 
as Planned 



ERIC 



Fig. 11-5. Activity flow charts by decision ^rea and program phase, lll< 
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important assumption on which the assessment is based is that it is the child's performance on 
mainstream tasks which results in his being viewed as successful or unsuccessful by the teacher. 
The child who fails to function typically on these tasks is considered by the teacher t^Kjiavj/a 
problem. Diagnosis within the context of the mainstream curriculum consists primarily of deter- 
mining the child's current level of proficiency on particular parts of the curriculum. 

In reading, for example, in what book and on wfiat pages can the child currently read at- an 
acceptable level ot correctness, with an acceptable level of comprehension, and what are the^ex- 
pectations for this child? It is assumed that any individual program, to be successful, must 
begin by determining where the child is and move him from that point as rapidlv as possible, 
Diagnos"fs of this type has the considerable advantage of placing the child within an instructional 
DECISION AREA: Program Adjustment PROGRAM PHASE: Progress Evaluation 

^What information 
is available on cumulative • 
progress / performance 



PROCESS: 

» 

MEASUREMENT 



EVALUATION 



13 



to date? 



Calculate Median Levels 
for Each Program Change 

I 



Calculate Discrepancies 
for Each Program Change 

] 



jCalculate TrefKJ and Direction] 
for Each Program Change } 

^ I ' 
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Is the 



program as implemented- ^^^^^'^ Adjust 



producing cumulative benefits ' 
fdr the student? 



Program 



COMMUNICATION 
COLUBORATION 



15 



^ Is the 

overall discrepancy < 
being decreased? 

I.. 

YES 

♦ Car, 
information gathered 
^^^on program change's 
beuscful toothers? 

h - 

YES 

[ Arrange fo'r Staffing 

^ Should 
further program modifications —YES» 
be implemented? 

NO 



AAake Recommendations, 
for Further Program 
Changes 



fig. 11-6, Activity flow chart, by decision area and program phase, IV, 
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DECISION AREA:' Program Certification 



PROGRAM PHASE: Outcome Evaluation 



PROCESS: 
MEASUREMENT 



EVALUATION 



' " ♦ What is the 

present progress / performance 
discrepancy? 

- I 

Calculate Discrepancies I 

i — 

W Should 
18 program as planned be 
terminated? « 



NRefer to 
Other Sources 



YES 



COMMUNICATION 
COLU^BORATION 



^Has program 



"'^s^planried been « 
successful if) reducing , . 

the discrepancy? provide help to 

. I ' student? 



♦ Are 

there other school 
resources that can 



YES 

▼Hasi)rogram 

been successful 
19 in satisfying needs 
or all parties? 

I 

YES 
1 



• NO' 



Refer to 
Special Station 



I Terminate and Follow Up 



Fig. 11-7. Activity flow chart, by decision^ area and program phase, V. 

materials sequence and, at the same time, of reducing the hiatus between diagnosis and remediation, 
which is so troublesome in special educational interventions. The process involved is a direct 
extension of the kind of "mastery learning" formulation articulated by Bloom (1968). 

The entire formulation fits neatly with the notion that the problem is not' a condition re- 
siding within the child; rather, the problem is the discrepancy that exists between the child's 
actual performance a:id the performance desired from him. Jhe discrepancy between the student's 
probable level of mastery and age and grade-level expectations, or. "normative" performance, is 
noted. Evaluation decisions revolve around agreement on what the problems ^re, how important 
are they, and is the child eligible for special education service. The decisions are based on 
the discrepancy data which are gath^ered and the priorities which are established by. the persons 
involved (including th/e child and parents). 



Deotazon Area: 
Program Seleation 



Program Phaae: 
Program Planning 



(Figure II-4) 



ERLC 



The program-planning phase involves agreeing upon a written plan that specifies (a) long- 
and short-range instructional goals and procedures for measuring progress on goals, (b) teaching 
strategies (hypotheses) which will be tried (operationalized) in an effort to reduce identified 
performance discrepancies, and (c) administrative a^rrangements to be used. 
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An important role played by the SERT during program planning is the development of alterna- 
tives for all parts of the program plan so that the decision makers (including the SERT) are, in 
fact, choosing among alternatives rather than just ratifying the SERT'fe decision. To ensure col- 
laboration» eacH person concerned with the studi»nt*s program and progress is asked to review the. 
proposed alternatives and to indicate approval or to offer suggestions for change/ improvement. . 
The plan is developed by the SERT who is responsible for circulating the written plan and nego- 
tiating any proposed modification. 



(Figures 

II-5 
II-6) 



Decision Areas: 

Pvogram Operationalization 
Program Adjustment 



^ Program Phases: 

Implementation Evaluation 
Progress Evaluation 



During the implementation and progress evaluation phases, attempts are made to insure that. ^ 
the planned program is carried out as intended and that the projected progress is, bein;? made. 
The rate at which goals are achieved determines whether alterations or adjustments in the stu- 
dent's program must be made. Evaluation during this phase is formative — intended to form or 
improve the program. Judgments of , skilly acquisition are based on predetermined criteria for 
mastery and stated objectives. Data arc taken daily or weekly and graphically represented on 
daily> weekly, and monthly graphs (see following chapters) to evaluate the effectiveness of altern 
ative strategies. Forces operating figainst effective implementation of the program are identified 
and alternatives are discussed. Other persons arc .identified for^tra^ing in implementing and 
adjusting the program plan. 



- (Figure II-7) 



De^jision Area: 
Program Certification 



Program Phase: 
Outcome Evaluation 



Decisions regarding program termination for a student arc evaluated in terms of the extent 
to which the stated discrepancies have been reduced, other service is available, and the referrer 
h^is been satisfied. Recommendations are made to those persons to whom future responsibilities 
have been assigned.' These recommendations are based on the data which have been collected through- 
out the program. ,7 ^ ' " 

- Development of Resource Systems ' ^^(, 

i * 

Data-based program modification provides the conceptual framework for the development of 
resource- systems for schools and school systems as well as for individual students. When. the. ^ 
resource ^3 stem is being organized to imptov.e programs for an individual student, the focus is 
on the discrepancies between the student's academic and social development and the expectations 
for his development which are held by people who occupy significant places in the student's Xif e > 
space. Programs are planned, implemented, and adjusted to reduce measured discrepancies. The^;' 
effect, of the program modifications in reducing the discrepancies is continually monitored and-- ^ 
evaluated. When performance discrepancies have been reduced to the point at whicli they no longer" 
are considered to be important, program modification can be certified, as complete or successful. 

When data-based program modification used to organize a resource system for a school's 
special education program, the focus is on the discrepancies between the spe.:ial education pro- 
gram as it presently operates and the desired operation of the program, as Identified by persons 
who occupy a significant place in the life of the school system. Once the discrepancies between ^ 
what the program does and what it should do have been identified, plans are formulated to reduce 
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Table II-3 
Data-Based Program Modification: 
' Summar)^ of Salient Features 



1. The student's academic and social behavior is always assessed in 
relation to the regular classroom as organized by the teacher and acted* on 
by his peers, and to explicit expectations for performance (by teachers, 
parents, and school) . 

2. The importance of the '^problem'* (i.e., the discrepancy between 
expectation and actual student performance) is determined through interpersonal 
negotiations among concerned parties (i.e., stjjdent, parents, professionals), 
and the actual observation of academic and social behaviors on the priorities 
which have been established in these negotiations. 

3. Intervention plans are developed consistent with the doctrine of, 
*'least restrictive alternative*' and the right to due'^process . 

A. Special educational interventions (program changes) are evaluated; 
systematic attempts to obtain cumulative benefits occur through making pro- 
gressive modificatibns in the physical envi,ronment , instruction, and motivation. 

5. Programing recommendations focus on "what works*' for the individual 
child and content validity is obtained by making the diagnostic process and the 
teaching process the same. 

6. Programs are made responsive to changes in performance through fre- 
quent reviews and evaluations. Decisions are data-based. 

7. Because evaluation of student progress is based on the summation of 
changes in performance on curriculum ta$ks, it is possible to determine if t^e 
special intervention is more successful than the regular, program in reducing 
the discrepancy between student performance and expectations. 



these discrepancies. Measurement procedures are devised to evaluate the extent to which the 
pltfns are implemented as well as the progress in achieving the agreed-upon goals. Wlien program 
discrepancies are reduced to the point at which they are no longer considered important, the 
resource system has been successfully developed. Although exploration of this aspect of data-based 
program modification is not the purpose of this book, it has been described generally to emphasize 
^the wide-ranging applicatit)ns of the DBPM decision-making framework."^ 

If resource systems are to function effectively, in support of teachers and children, the 
persons responsible for their development and management must learn to understand and use a 
systematic decision-making process. Data-Based Program Modification, as it is conceptualized in 
the matrix (Fig. II-2), provides a decision framework for developing resource systems and for 
operating within these systems. Table II-3 summarizes the salient features of DBPM. 



The Center for the Study of Evaluation at U.C.L.A. has developed materials that explore this 
aspect of system development. 

41 



30 



References 

Bloom, B.S. Learning for mastery. Evaluation Comment, 1968, 2(2). 

Klein, S., Fenstermacher , G. , & Aiken, M.C. The Center's changing evaluation 
model. Evaluation Comment, 1971, ^(4), 9'-12. 



42 



Chapter III 



THE MEASUREMENT AND EVALUATION PROCESSES 



Time Series 

What makes the program modification system "data-based" Is the application of time series 
research procedures to student performance under different Instructional conditions. When approp- 
riately applied, time series research permits reasonable conclusions to be drawn about the relation 
between the changes In a student's program and the changes In his progress. These measurement and 
evaluation processes are central to DBPM. . . 

The kind of time series data which SERTs collect to monitor pupil performance .is the same as 
that used in the functional analysis of behavior by behavioral psychologists to evaluate the ef- 
fects of changing reinforcement contingencies. Time series data are also collected by highway 
departments to.monltor accident rates, police departments to monitor crime rates, health organiza- 
tions to monitor disease incidence, and physicians to monitor vital signs. The application of 
time series research designs to performance is an analytic procedure which can be used whenever 
Information on events occurring over time is desired. 

A simple illustration of the application of a time series is presented in Figure III-l. The 
data graphed are the millions of .pieces of franked mall sent out by U. S. congresspersons during two 
election years and the intervening nonelectlon year. From the graph, certain information can be" 
derived, such as. (a) volume of franked mall is greater during election than nonelectlon years; 
(b) volume of franked mall is greater in the election years between general elections: and (c) 
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Fig. m-1. Use of franked mail by U.S. congressmen during two election and one nonelectlon 
years. Source: Comon Cause Bepovt, 6(7), 1975, 8. 
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volume of mail is greater in the fall of election years and the summers of nonelection years/ The 
third item "of information is possible because the time series shows the changes in volume of mail 
over the months of each year. Taken together, the information yields the conclusion that the amount 
of franked mail a congressperson sends out is determined biy the imminency of elections. This con- 
clusion is validated by the repetition of the election year pattern. 

In typical programs in schools, students are tested at the beginning and end of instructional 
sequences. Under such conditions, it is not possible to draw conclusions about the relation of 
changes in the instruction to changes in student perfonaance, Campbell and Stanley (19.63) referred' 
to research using pre-post testing as a "bad example" that does not permit reasonable conclusions 
to be made about the effects of changes because other plausible explanations for what is observed 
cannot be ruled out. . 

In our chart of franked mail, for example, we can see how pre-post testing effects interpret- 
ation. Suppose we were to compare volume of mail on the same date in election and nonelection 
years. If that date were June 1, our comparison would indicate that the volume of mail was great- 
er in 1973 than in 197/*, and we would have to conclude that elections have no influence on volume. 
However, if we chose September 1 as the comparison date, our conclusion unquestionably would be 
the opposite. Obviously, time of administration strongly influences the results of pre-post test- 
ing. 

In Figure II1-2, other examples are given of the invalid conclusions that are promoted by the' 
use of pre-post testing. ThiS graphs show the performances of four different students who have been 
referred to a SERT for individual instruction in oral reading. Each graph represents the trend of 
a child's rate of reading the local newspaper before and after SERT intervention; testing occurred - ^ 
at the points indicated by "pre" and "post." 

In each graph, posttest oral reading rate is higher than pretest oral reading rate. Using 
just the pre- and posttest scores, the clear (and correct) conclusion is that in each case SERT 
intervention increased oral reading rate. However, if we used the information on student growth 
that was obtained through frequent testing, we would see clearly that in only two cases (C and D) 
did SERT Intervention actually improve the child's growth in oral reading rate. SERT intervention 
appears to have had no effect on child A's growth and actually to have decreased the growth rate 
for child B. The depiction for child A is a special problem when evaluating special eaucation 
interventions beccuse growth is characteristic of all children, and pretesting-intervention-post- 
testing will resjlt virtually always in the measurement of growth which should be attributed to 
developmental factors rather than instructional intervention. 

In addition to 'evaluating specific program effects, time series analysis enables us to see 
what is happening to child performance while the program is in progress, and to distinguish planned 
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Fig. 1 1 1-2. Performance graphs of four students in reading, before and after Interventi 
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from unplanned effects. For example, a program modification for one child may have all its , 
effects during the first week of intervention and none thereafter; for another child, a program 
modification may never affect performance. Thus, time series analysis enables us to observe the 
form of the program modification over time. Posttests, usually scheduled at the teacher's dis- ' 
, cretion, may require the student to practice a task long after he has achieved mastery; or the 
student may be subjected too long to a neutral or negative treatm'ent. 

DBPM requires the special education teacher to function as an applied scientist, that is, 
to test hunches (hypotheses) about what might help the student improve his performance, and to 
make instructional decisions on the basis of objectively'determined effects rather than subject- 
.ively formed speculations. Thus, the special educator is not required to function as a "trapped 
administrator" who must try to predict with certainty whether a specific program will be effective 
for a specific child. Instead, the speciaJ educator introduces (hypothesizes) a program, carefully 
monitors (t^sts) the child's performance and progress in the program, records the obtained data 
on graphs, and alters the program (forms a new hypothesis) in the ways that seem indicated to 
optimize the child's progress. 

Continuous Feedback: Charting Program Effects 
The key or central element of successful DBPM is the graphed record of student- development . 
A graph of observed development over time (time series data) provides the information that is 
needed to make critical decisions about the student's movement from past to present status in 
his program of instruction. Further, it affords some basis for predicting future development 
under different instructional, incentive, and/or administrative arrangements. In the long run, 
the graphed relation between changes in the student's development and changes in the program pro- 
vides the data base for making evaluative judgements about special education intervention. 
In DBPM, two basic graphs are used to display daily, Weekly, and monthly data: 
1. Progress (or Mastery) Graphs. 
2* Performance Graphs. 

Progress (or Mastery) Graphs 

A progress (or mastery)^ g^aph is constructed to display the time it is taking a student to 
master a set (usually, ordered over time in terms of sequence and/or complexity) of instructional 
objectives. In constructing the graph, the series of objectives the student is working on is 
shown on the ordinate (up the left side) along with the time in which the objectives are expected 
to be achieved, and the time—days, weeks, or months— during which the strident is working on the 
objectives is shown on the abscissa (across the bottom). A point is plotted at the intersection 
of the relevant vertical time line and horizontal objectives line when mastery'has occurred. 
Points are plotted sequentially and connected; the result is a line showing the one-to-one rela- 
tion between time of mastery and time in school. 

The progress graph can be used in any classroom where or program in which specified tasks 
to be mastered can be identified in relation to time. The tasks may be objectives that are inde- 
pendent of any particular curriculum, or they may be requirements imbedded within a particular 
curriculum sequence. In the objectives-based approach, where the t isks are independent of a 
particular curriculum, the sequence of objectives to be attained and the^time allotted for attain- 
ment are laid out on the ordinate, and the days, weeks or months of school attendance arc listed 
on t scissa. In the <5pecific curriculum and curriculum-sequence approach, the abscissa is 
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Fig. 1 1 1-3. (a) A procjress gcaph organization for an ordered sequence 
of objectives, (b) A progress graph organization for an 
established curriculum in reading. ^ 

also labeled for time in schppl by days, weeks, or months and the ordinate shows t;he curriculum 
sequence and the time allotted for attainment of each item of the sequence. Figures III-3(a) and 
(b) illustrate the graph organizations for the Two approaches. 

In both approaches, the graph is a square drawn on equal-interval paper. On both axes, the 
equal number of equally spaced squares ajre marked to represent equal time periods. On the verti^ 
cal axes, the number of tasks are spaced according to the time of mastery expected of average stu- 
dents in this curriculum. Thus, the graph is organized so that for the average student the level 
of progress (mastery) is one to one; For each week, month, or year in the program the average 
studen.t is expected to master t^e number of tasks designated for that week, month, or year. If 
achievement of average studentj is plotted week by week, month by month, and year by year, the line 
connecting these points is a diagonal from the lower left corner to the upper right corner of the 
graph. 

For the target student, the progress level usually differs from the one-to-one ratio because, 
typically, he has* not achieved a week's, month's, or year's progress in the designated time period. 
Thus, when the target student's mastery level is plotted on the graph, the discrepancy between his 
progress and that of av.erage students is graphically illustrated by the distance of his progress 
points from the diagonal line of average progress. 

Performance Graphs 

1 

A performance graph is designed to display how a student's behavior changes on a eingle task,' 
such as "oraJ reading from an age/grade appropriate reader" or "off-task behavior during work ; 
time," over time. On the performance graph, the abscissa again shows the time in days, weeks, or, 
months of the program during which measurementSi^ are made. The ordinate simply shows the level of 
performance on that single task oh a day when that performance was measured. Thus, in Figure 
III-4 (a), the ordinate (vertical axis) shows the number of vords read correctly and incorrectly 
per minuta; and in Figure III-4 (b), the ordinate shows the number of off-task behaviors per 
minute during work time. ' ; " ' 

Either equal-interval or equal-ratio graph paper can be used in developing performance 
graphs, depending on which is preferred or more useful. In both forms the vertical lines rep- 
resent calendar dates. On equal-interval graph paper, the equally spaced horizontal lines can^ 
l?e designated to represent a number, percentage, or rate (frequency). On equal-ratia graph paper, 
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Fig. 1 11-^. (a) A performance graph for "oral reading from age/grade / 
appropriate reader." (b) A performance graph for # of 
' off-task behaviors. 

the horizontal lines are so drawn that performance changes which are proportionately equal are 
visualized as equal. ^ Since a change in behavior from 2 to 4 is a "two times" increase (i.e., 
2 X 2=4), it is shown as equal to a change in behavior from 50 to 100,, which is also a "two times" 
increase (i.e., 2 x 50=100). 

Equal-ratio graph paper is semilogarithmic (multiply and divide) rather than additive and has 
' b-en popularized through Precision Teaching as the Standard Behavior Chart (Pennypacker, Lindsley, 
& Koenig, 1972). What is often obscured in discussions over the relative merits of equal-interval 
and equal-ratio graph paper is that both display the results of regular and frequent measurement * 
of student performance over time. Both are designed to permit analysis of time series data. The 
only real difference between the two is that equal-interval graph paper emphasizes absolute differ- 
ences and equal-ratio graph paper emphasizes relative differences. 

Choosing the Right Graph 

Whether you use a progress (mastery) graph or a performance graph depends solely on the kind 
of data you wish to use as the basis for program modification decisions. If the rate at which 
a student is mastering a set of tasks is important, then a progress graph is most useful. If 
changes in level of performance on individual taskb rremore important, then performance graphs 
are likely to be most helpful. Many SERTs with whom we have worked develop and maintain both kinds 
of graphs because they are interested in both kinds of data. Since the "grade equivalent"/"grade 
level" score is widely used in school programs, to maintain communication it may be most useful 
to represent student development on progress graphs for school staff and parents. ^c::: 

Listed in Figure III-5 are some examples of behaviors which can be charted on performance 
and progress graphs. Note that the level of specificity in the examples increases with the fre- . 
quency of measurement. 

Absoissa. The choice of time period for the construction of the graph depends upon the 
length of the curriculum and the pinpointed behaviors. Typically, at the elementary Isvel, monthly 
progress and daily progress and/or performance graphs are kept on an individual student for read- 
ing and other basic skill areas. Additional graphs may be kept on various aspects of social be- 
havior. 

Monthly progress graphs can be constructed to span time periods of any length, although a 
period of an academic year is usually best. At the elementary level,' where reading programs 
usually begin in the first grade and continue through the sixth, a 6-year monthly progress graph 
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can be- constructed for the entire program'; if the rjeading program begins in kindergarten, the 
monthly graph can be extended to record progress over the 7-year period. 

At both the elementary and, particularly, '.he secondary level, monthly progress graphs can 
be constructed for curricula of any length, depending on how many years each curriculum spans. For 
example, if a science curriculum were to include General Science (1/2 year). Biology (1/2 year), 
and Physics and Chemistry (2 years), the monthly progress gf^iph for the entire curriculum would 
span three years. If you considered it necessary, you could make up a progress graph of the ap- 
propriate time period (1/2 year or 2 years) for any part of the curriculum. In the same way, if 
a nath program were to extend over two years, the monthly progress graph would be constructed for 
that period. ♦ 

Graphs to record weekly or daily rates of progress and performance work best when, they are 
limited to periods of one school year or less. 

. Rates of progress graphs for different time, periods are shown in Graphs 1-5. Graphs 1 and 
2 show monthly, rate of progress, the first for a 6-year curriculum, the second for a 7-year cur- 
riculum. In each graph, note that each horizontal and vertical line represents one month, and 
every ninth line represents one year. Graphs 3 and 4 are weekly progress graphs, the first for 
a curric.ilum of one school year, the second for a curriculum of 12 weeks. In each graph, each ver- 
tical and horizontal line represents one week. Graph 5 shows daily rate of progress for 98 days; 
thus, each horizontal and vertical line represents one day of school. 

Examples of performance graphs are shown in Graphs 6 and 7. Both span periods of 140 days, 
approximately one half of a school year< including Saturdays and Sundays. 

Although frequent monitoring and graphic display can be used for any sludent by any teacher, 
they are an essential element in the modification of programs for children whose development is 
significantly different from their grade-age peers. - 
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Discrepancy Measurement and Progress Estimates 

y Before a SERT modifies a program for a referred student, the following two items of inform-^ 
atlon must be obtained: 

V 

1. The discrepancy between the target student's progress/performance and desired progress/ 
performar^te as determined by teachers and peer sampling. 

2. An estimate of the progress which is required for the target student if the discrep- 
ancy is to be reduced withiji a specified time interval. 

This information is the basis for problem and program selection decisions. ' 

o 

Which progress and performance discrepancies are determined 'depends upon the curriculum of 
thD referred student's school and the behaviors which have been- identified as important in the 
initial referral and subsequent interviews. 

When mastery of a set of tasks (sequenced or not) has been established as the behavior 
of concern (which is common when definite e;Cpectations have been set at each grade 
level), then discrepancy in progress is determined. ^ 
2. When degree of profiqiency on a single task (i.e., how well the student *reads, writes, 
or computes^ is rhe concern, then discrepancy in performance is determined. 
Discrepancies can be described visually or numerically. 

Describing Discrepancies Visually 

On a progress or performance graph, it is possible ,to illustrate visually the discrepancy 
between the referred student's progress or performance and that of his peers v7ho are progressing 
or performing consistent with cultural expectations and, hence, are considered to be "average.** v 

The weekly progress graph shown in Graph 8, for example, visually illustrates the discrep- 
ancy between desired mastery level for average students on a set of math categories and the refer- 
red student's actual mastery level on the same set of categories. 
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*Graph 8. Weekly ra^e of progress graph in a curriculum for^^one year of school: Math. 
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The daily performance graph shown in Graph 9 is a visual representation of the discrepancy 

between the number of words read per minute in a textbook by average students and the number read 

per minute by the target student. (For reasons of space, the graph has been cut down.) 
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Graph 9. Equal-ratio pe formance graph for oral reading performance. 

The visual display of discrepancies usually provides a measure for communicating most clearly, 
with staff, parents, and child. Many decisions can be based on visual displays alone. When more 
precise information is required however, the discrepancy also can be described numerically.. 

Describing Discrepancies Numerically 

To compute a numerical discrepancy for a progress gcaph two items of information are needed: 

1. the desired level of progress (mastery) on the set of tasks (i.e., the 
curriculum units or objectives) for a reference group of students (usually 
the average of the sane-aged peers); and 

2. the actual level of progress (mastery) of the referred student o"n the 
set of tarics. 

Wlien the desired and actual levels of progress have been determined, the discrepancy ratio^ 
which is the relative difference between the two levels, is easily computed by dividing the higher 
level of mastery by the lower level. The result of this division always yields a number that is 
greater than or equal to 1.0 and specifies the number of times greater or.e progress level is than 
another. Ordinarily, the result tells us ho w> many times faster the average student is progressing 
through or performing on the set of tasks than the referred student. 

In. Graph 8, we plotted data for an individual student on mastery of math objectives. To 
determine tHp discrepancy ratio for this student, we follow the numbered steps. 
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I STEP 1 1 Detemine Actual Lr^H of Pvogress. 

This level is the number of weeks (months or years) of progress achieved 
in the time already spent in the instructional program. In Graph 8, we 
can see that the student has been in the program for 16 weeks. In that time, 
he has mastered Level I material, which is equal to 5 weeks of progress 

for average students. 

Determine Desired Level of Progress, 

Desired progress is^ one week for each week in the program. (If the 
graph were developed for units of days, months, or years, desired progress 
would be expressed accordingly. The important point is that on progress 
graphs the relation is always one to bne: one unit of progress for one 
unit of time.) In Graph 8, then, a student who has been in the program 
for 16 weeks should have mastered 16 weeks of work (in this case. Level 
III in the curriculum). 

fsTEP 3] Compute the Discrepancy Ratio. 

The higher level of progress must be divided by the lower level of 
progress. The formula is, 

Discrevancu Ratio = ^^ff^^ Number (Level of Progress) ^ 16 Weeks . o ov 
utscrepancy Ratzo ^^^^^^ iVi^m^er (Level of Progress) " 5 Weeks = ^ 

Since the discrepancy ratio tells us how many times greater one level of 
progress is than another, in this case it tells us that students progress- 
ing at the desired rate of progress are progressing 3.2X faster than the 
target student. (Conversely, the target student is progressing 3.2y slower 
than the desired rate of progress.) 
To compute the discrepancy for a performance graph two items of information are also needed: 

1. The dosired (usually the median^) level of performance of average students on the skill 
or behavior of interest; and 

2. The actual (median) level of performance of the referred student prior to program modifi- 
cation. 

The procedure used to compute the performance discrepancy ratio is the Same as for the pro- 
gress discrepancy ratio: Divide the higher level of performance by the lower. The result is a 
number greater than 1.0 that indicates the number of times greater one level 9f performance is 
• than the other. % 

In Graph 9, we plotted data for an individual student's performance in oral reading. We 
compute the discrepancy ratio in oral reading performance between this student and average stu- 
dents in the class as follows: 

I STEP 1 I Determine Actual Level of Performance. 

There are 11 data points on Graph 9 for the referred student's perform- 
ance in oral reading. Wlien we order these numbers from low to high — 48, 49, 
50, 50, 52, 52, 52, 60, 60, 70, 75— we find that the median (or middle num- 
ber) is 52. This is actual (baseline) performance for the referred student. 
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The median is the score that divides the distribution into halves; 50% of the scores fail below 

the nedian and. 50% above. The median, along with the mode and mean, are measures of central 

tendency. Any of these measures may be used but we prefer the median because it is less sensi- 
tive to extreme scores and is relatively easy to compute. 
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Were only one sample of performance available, we might have a somewhat 
different picture of this student's performance level in oral reading, 
depending upon which day testing was done. 
I STSP 2 I Determine Desired Level of PerformanQe . 

Median performance for average students in the school in" oraJ 
^^^^^^^^^^ reading is 100 words per minute. This is desired perf ormanc'e, 
f STEP 3 I Compute the Disorepanoy Ratio. 

The higher level of performance must be divided by the lower level 
of performance.. 

Discrepanoij Ratio = ^^^^ ^^^^^ ^^^^^^ Perfomanoe) ^ 100 
Smaller- i^xvriber (Level of Performance ) 52 

In this case, the discrepancy ratio tells us that students who are 

reading orally at the desired level are performing 1.9X faster than 

the referred student (or the referred student is 1.9X slower).. 

Other examples: 1. Desired Performance = 20/min.; Actual Performance = 20/inin. 

Larger Level of Performance 20/min. 

Smaller Level of Performance ^ 20/min . ^ ^ (There is no discref^ancy. ) 
2. Desired Performance = 30/min. : Actual Performance = 60/min. 

Larger Level of Performance 60/min. 

Smaller Level of Performance " 30/min. " (Actual performance is 2X 

faster than desired performance. ) 

|aPPLICATIQNJ In Graphs 10a and 11a, two further examples of data on student progress 

and performance are shown. I^i each case the discrepancy ratio is not 
computed. Make the computations yourself. 

^ I EXAMPLE; Computing a P rogress Discrepancy Ratio. { 

John has been referred for program modification in reading by his classroom 
teacher. Desired progress in reading at John's school is determined by 
mastery of the material in the Basal Reading Series. The levels to be 
mastered at specified points in time are listed on the ordinate of Graph 
10a. These expectations represent desired mastery for average students 
progressing at an average rate, as determined by classroom teachers, ad- 
ministrators, and other school personnel. To determine the discrepancy 
ratio we will: 

1. Determine John's Actual Level of Progress. 

John's mastery level is beginning Level II or 6 months of 
progress. John has been in school for 22 months. 

2. Determine Desired Level of Progress. 

^ Since John has been in school for 22 months, he is expected to 
have progressed 22 months in the reading series (completion 
of Level 5) . 

3. Compute the , Discrepancy Ratio. ^ (Check your answer below. ^) 
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Since the discrepancy ratio Is the larger number divided by the smaller, we divide 22 by 6 
John s progress is 3.7X slower than desired. * 
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Graph 10a. John's progress in the Basal Reading Series and desired progress for 
students progressing at an average rate. 

\ IeXAMPLE: Computing a Performance Discrepancy Ratio | 

Sally has been referred for program modification by her classroom teacher. 
The teacher feels Sally's difficulty with handwriting slows down her work 
completion. To determine If a, discrepancy exists the discrepancy ratio will 
be computed. 

1. Compute Actual (Baseline) Per*foTimnce Level. 

Three data points on Graph 11a— 10, 15, 15— represent Sally's 
performance in handwriting on three occasions. The median 
of these three points is 15. This is Sally's actual (base- 
line) performance in handwriting. 

2. Determine Desired Performance Level. 

In Sally's class, median performance on writing letters per 
minute is A5. This is the desired rate of performance. 

3. Compute the Discrepancy Ratio. (Check your answer below. "^^ 

Estimating Progress/Performance Requirements 

After the discrepancy ratio has been computed, the next step in DBPM is to estimate how much 
progress/performance must be achieved to reduce (or eliminate) the discrepancy within a specified 
time period. 
3 

The discrepancy ratio is 3X. Sally is performing 3X slower than average students in her class. 
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Successive Calendar Days 
Graph 11a. Equal-^atio performance graph: letters written per minute. . 

A progress estimate specifies the amount of progress to be made in one of two ways: (a) per 
unit of time (i.e., number of months of progress/month); (b) per amount of material (i.e., number 
of tasks, pages, etc., to be mastered per unit of time). 

The performance estimate specifies the amount of change in performance required per unit of 
time (i.e., 1.5 math facts faster/week; .5 fewer noise behaviors per week, etc.). 

Both estimates are valuable data for program planning and program adiustment dccisi6ns. Esti- 

4 

mates are made of (a) how much more rapidly a student must progress than prior .to tne Interve tlon; 
(b) how much material must be covered;, and (c) how much faster or slower a student must perform 
certain tasks. Such estimates provide information with which to plan the student's program; write 
program objectives; monitor program implementation; and evaluate program modification effects. 

Should 20, 30, or 40 objectives' in the riext 30 weeks be the progress goal for student A? 
Should student B Increase Ms oral reading rate by 5, 10, or 15 words/week? Should the objective 
for student C be to decrease noise bel\avlor by two/minute each week? The teacher. need not be 
faced with an arbitrary prediction of how quickly a student's behavior needs to change. The 
necessary rate of progress/performance change can be estimated with seme precision by the follow- 
ing procedure. 

Computing Progress/Performance Estimates 

I ^'^fr^ l\ Determine the length of time available to implement the progrwn modification. 
I STEP 21 Determine the improvement needed in progress or performance. 

a. Determine what mastery performance level is desired at the end of 
-the intervention period. ()() 
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P For Progress Graphs j 



Find the calendar date on the horizontal axis that represents the 
proposed conclusion of the program modification. The point at which 
this line intersects the diagonal line of the graph is desired mastery 
level. 

} For Performance Graphs'! 

The median performance of average students at the time of initial 
assessment or a standard performance level, such as the Starlin guides, 
are used as desired mastery level. 

b. Subtract the target student *s present mastery or performance 
level from desired level (mastery or performance) to determine the 
amount of improvement needed 
1^'^^^ -^1 Divide improvemeni needed (mastery or performance) by the time avail- 

able for the intervention to determine progress performance needed per 
unit of time. 

I APPLICATION I Here are four examples of progress/performance estimates for John 

and Sally. We have estimated progress for two intervention periods 
for each student: 5 months and 14 months for John, and 15 weeks and 
30 weeks for Sally. 

[ 



EXAMPLE; Progress:. Estimate for 5 M onths for John. 
ISTEP 1 1 Time Available = 5 months. 



Desired Mastery Level = 5 months from present (or end of Grade 3) = 27 months 
Present Mastery Level = 6 months (or middle of Grade 1) = 6 raonths 



Improvement Needed = 21 months 

iSTEP 3 I Progress Estimate. ^ 

A. Per Unit of Time: 

Improvement Needed 21 months mastery 

Time Available ^ Tnwn'ths " months of progress/month 

B. Per Unit of Material: ^ 
Improvement Neede^d = 21 months mastery 

On the vertical axis of the graph, 21 months of mastery bep.inninj:; 
at month 6 (John's present mastery level), and continuing through 
month 27 (6 + 21), includes completion of Book Levels II, III, IV, 
V, and VI. 

The number of pages to be mastered at each level is as follows: 
Level Pages 
II 100 
III 190 
IV 175 
V 200 
VI 285 
[Total] 950 
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Therefore, the monthly progress estimate is: 

Improvetnent Needed 950 Pa ges .^^ ^ , , 

Time Available " 5 months ' P^^es of mastery/month 

The weekly progress estimate is: 

Improvement Needed 950 Pages ^ , , , 

Time Available 20 weeks ^^'^ P^^es of mastery /week 

The daily progress estimate is: 

Improvement Needed 950 Pa ges ^ - ^ ,^ 

Time Available " 100 day,s P^^es of mastery/day 

I EXAMPLE 2*^ 

What would the progress estimate be for a 14-month intervention 
period? Compute this progress estimate and check your answer below. ^ 



, IeXAMPLE 3: Performance Estimate- for 20 Wee ks for Sally. (See Graph 11a. ) 
I STEP 1 1 Time Available ^ 20 weeks. 

' STEP 2 I Desired Performance = 45 letters/minute (assuming average students do not 

increase speed) . 

Actual Performance ^ 15 letters/minute ' * 

Improvement Needed " 30 letters/minute 'faster 

l- ^*^^^ Performance Estimate - letters ^ ^ ^5 letters/week faster 

20 weeks 

I EXAMPLE 4: Performance Estimate for 15 Weeks fo r Sally | 

I STEP ry Time Available = 15 weeks. 

IStep 5 I Desired Performance = 45 letter/minute. 

Actual Performance- _ 15 letters/minute 

Improvement Needed ",30 letters/minute faster 

I STEP 3 1 Performance Estimate - (Make the computation and check your answer below. )^ 
Writing Program Objectives 

The procedures discussed up to this point are all that is required to write program object- 
ives. Several examples of such objectives follow: 



EXAMPLE 1: Program Objectives for John: Reading in the Basal Series. 



Longe Rayxge Objective for a 5-month intervention period. 
Given a selection from any book in Level II-VI in the Basal Reading 
Series John will read the selection at a rate of 50 words/minute with 
2 or fewer errors and answer comprehension questions with 80% accuracy. 

Daily Objective for a 5-month intervention period: 



4 

Improvement needed is 30 months in 14 months or 2.1 months/month. On the vertical axis of the 
graph we can see that 30 months of progress beginning with month six and cpntinuing through 
month 36 (6 + 30) includes completion of Book Levels VII and VIII. Since there are 440 pages in 
Levels VII & VIII, the total number of pages to be mastered is now 1390. When divided by time 
available, we find that for a 14-month intervention, John must master 99 pages per month (1390 
divided by 14;; approximately 25 pages/week (1390 divided by 5£ weeks); and approximately 5 
pages/day (1390 divided by 280 days). 

^For each week of the 15-week intervention, Sally will have to write letters at a rate which is 
two letters faster than the previous week (30 divided by 15). 
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Each day of school, John will read approximately 9.5 pages in 
^ the Basal Reading Series at a rate of 50 words/minute with two or 

fewer errors and answer comprehension questions with 80% accuracy. 
Weekly Objective for a 5-inonth intervention period: 
Each week of school John will read approximately 47 pages in the 

Basal Reading Series, etc. Can you write long-range and daily 

objectives for a j4~inonth intervention period for John? 

[example 2: Program Objectives for Sally's Performance in Handwriting | 

Long Range Objeotive for a 15-week intervention period: 
Given a .paragraph to copy from the board, Sally will write the para- 
graph at a rate of 45 letters/minute with 100% accuracy. 
I Daily Objective for a 15-week intervention period: 

Each week, when asked to copy a paragraph from the board, Sally will 
copy the paragraph at a rate that is two letters faster than the pre- 
vious week and with 100% accuracy. 
• Can you write the long-range and daily objectives for a 30-week 
intervention period for Sally? 

Visually Describing Progress/Performance Estimates ; 
Drawing Estimated Progress and Performance Lines on Graphs 

The estimated progress or performance lines are visual illustrations of estimated progress. 
What is indicated by the line is general trend and direction which the data must take ba«ed on 
the progress/performance as estimated. Here is how to draw estimated progress performance 
lines. ' 

a. For progress graphs, find the present mastery point for the target student and the 
desired mastery point at the completion of the program modification. Connect the two points 
with a broken line. 

b. For performance graphs, find the points that represent the present median performance for 
the target student and desired performance at the completion of the program modification. Con- 
nect the two points with a broken line. 

APPLICATION I In Graphs 10b and c estimated progress lines are drawn for John for 
the two intervention periods of 5 and 14 months. 

In Graphs lib and c estimated performance lines are drawn for Sally ' 
w for 20- and 15-week intervention periods. 
Each time a point is plotted on a graph or the student's program is reviev;ed, actual pro- 
gress/performance may be evaluated in terms of its relation to the estimated progress/perform- 
ance line. No computation is needed. Program adjustment decisions are in large part determined 
by whether the progress/performance estimate is being approximated. While actual achievement may 
never reach estimated achievement, the information thus derived continually influences and 
guides program modification decisions. Deviations from the line signal the need for a pro- 
gram change. (See Part IV, Decision Rules for Making Program Changes.) 
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Graph 10b. John's estimated progress for a 5-month intervention. 
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4J Graph 10c. John's estimated progress for a I'l-month intervention. 
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Graph lib. Sally's estimated performance for a 20-week intervention period. 
STUDENT: SCHOOL: CURRICULUM: 

0 4 . , 8 12 16 




II MH IIt I >» , ^ 

•000695 ■<l ll l|i|ll!l l l l ll l l ll |ll llll|llllll l lll l ll il l | l || | || |||| |l | || || | | | |||| ||| |||| |||||||| || |||||t||i< >|tH ||||||||||t Mn i lM 



ERIC 



0 10 20 30 40 50 60 70 80 90 100 110 120 130 140 
Graph lie. Sally's estimated performance for a 15-week intervention period. 
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Are Other Data Needed In Data-Based Program Modification ? 

All the basic data collection, graphing, and computation procedures of DFPM have now been 
presented. This information Is reviewed In subsequent chapters. In addition, there are described 
procedures for data analysis. These are based entirely on the discrepancy ratio and graphed data 
we have described. - 
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PART II 

Devfeloping DBPM Skills in^ 
Problem Selection 



Introduction 

In Part II there are described the specific procedures that are used in the Problem Selection 
phase of DBPM. The organi*.iti6n follows the format that is shown in the flow charts in Chapter 
II. 

Part II is divided into three chapters: Chapter IV, commun j^cat iojv^^nd collaboration proce- 
dures; Chapter V, measurement procedures; and Chapter VI, evaluation procedures. 

Each chapter starts with an overview and then lists the questions that are specific to the 
matrix cell on which the chapter is based. The third and main part of the chapter comprises the 
data^gatherl ng activities by which the matrix cell questions are answered* All necessary proce- 
dures, materials, and forms are discussed in detail and KUustrated. Throughcyt, the general is 
made specific in the example of Ricky. 

Try to keep the following questions in mind as you go through the chapters: 

1. What is the problem that is the basis for the niferral and what is its 
importance in the setting in which Che pupil is asked to function? 

-0, 

2. What would be the discrepancy ratio for a student like Ricky and the 
average students in your school? 

3. Would the discrepancies be considered important?* Would a student like * 
Ricky be e}i'g*ibje for service? 

Can you pinpoint simi !ari ties gnd differences between DBPM procedures 
and those which you have used in the past in problem selection? Are 
the differences important? 
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PROBLEM SELECTION: 



Chapter IV 

INITIAL COMilUNlCATION AND COLLABORATION 



Deaision Area: 
Problem Selection 



Program Phase: 
Initial Assessment ^ 



Overview 

One of the most frustrating tasks facing special 
educators in the development of successful individualized 
programs to Integrate handicapped children into main- 
strc-iii programs is determining "the problem." Handicaps 
themselves permit us only to speculate on why a pupil is 
difficu.lt to teach; merely identifying a handicap oftep 



Contents ^ 

-Overview 
Matrix questions 
Data-gathering activities and' 
forms ' ;.; 



obscures the pupil's instructional program needs. For example, if a hearing-impaired child in the 
fourth grad^ has the vocabulary comprehension of a second-grade pupil, the problem is not that 



ho 



is hearing impaired but that there is a discrepancy between his performance in language compre- 
hension and the performance considered culturally desirable for fourth graders. To successfully 
integrate such a. child,* the educational program must. either improve his langauge comprehension or 
change the cultural desire for language comprehension. From our point of view then, "the problem" 
is never the child's handicap; it is always the discrepancy between desired and actual performance 
(or progress). • - * 

In Data-Based Program Modification, the initial step in id^entJfying the problem is -to deter- 
mine the performance that is desired. The task is. not easy. There are many people, whose desires 
for performance must be considered. The most significant are the referring teacher and other 
school personnel with whom the student must interact. Yet, in many school systems it is note- 
worthy that the only area in which it is possible to identify a series of desired performance 
levels is the reading program; in most other subject areas, performance desi of teachers differ 
significantly from class to class and school to school, even within tho S2.v:.^ district. Thus, 
although the perceived discrepancy between desired and actual performance is the basis for a 
pupil's referral,, information .on what is desirable is often difficult to elicit. 

A s^imple illustration is the common desire of classroom teachers for all children to sit in 
their seats and not talk, unlesa they are directed otherwise. In these days of criticism by ad- 
vocates of open schools and classrooms, such a desire may 6e publicly unmentionable; behind the 
classroom door, nevertheless, it may f ignif icr^ntly influence the life of a pupil. (Like many 
other classroom observers, we have found that, "out of place" and "making noise" are two behaviors 
that, if they occur too frequently, identify a child as a behavior problem.) " * 

One method of obtaining information on desired performance is to conduct interviews and 
distribute questionnaires that provide the framework for establishing and/or negotiating desired 
performance goals. Thus, arrangir interviews, obtaining parental consent, and determining the 
order of performance goals, as well as conducting the interviews, should be given thq highest 
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priority. 

In contrast, some teachers deny that they desire certain general performance from all of 
their pupils; they state that "each child is an individual with his own unique characteristics" 
and, therefore, with his own unique set of performance needs. ^ Such teachers may overlook the 
fact that they may desire common performances lijce "independent decision making" or "self-suffi- 
ciency," and that they identify as discrepant children who fail to operate independently. The 
identification would not be made if individualized goal setting really existed. 

Anyone who cares about a child's ability to cope with the world probably holds some precon- 
ceived expectations for him. We should attempt to be more explicit about these expectations and ^> 
not to allow them to remain implicit. ("Is the .unexamined desire worth having?") It is ex- 
tremely difficult for a special education resource teacher tq work in a context in which desired 
performance is not stated and the attempts to make desires expl'icit are thwarted by defensive 
teachers, administrators, or parents. Yet experience proves that whenever a child is identified 
as having or being a problem, some incongruity or discrepancy between desired and actual perfqrn- 
ance can be identified*. 

A good exartple is Ms. B. , a third*grade teacher at River Run School who has just begun the 
year with a new class. Although it is only a fe'w days inta the term, Ms. B. already has identi- 
fied a number of children who* she believes, "have problems." Of particular concern to her is 
Ricky; he always seems* to be in the middle of a fight, complains a lot that people are teasing 
him, and appears to be very inattentive and disinterested in academics. Ms. B. runs a 
fairly "tight ship," and although she has difficulty being explicit about her classroom expecta- 
tions, it appears that Ricky is not meeting her expectations for perf ormnce^).^ When asked by 
^the SERT in the school if she believes any children in her class should be referred, Ms. B. 
immediately thinks o,f Ricky and fills out a referral form. The SERT, together with Ms. B. and 
others in the school charged with making placement decislQjns for special education service, now 
face the following questions: 

1. What is the problem(s) that is (are) the basis of the teacher's referral. 

2. Who owns the problem? Is the problem the pupil's? teachet' s? (In example, it is Ms. B.'s.) 

3. What is the discrepancy between the desired performance for the pupil and the pupil's 
actual performance. 

4. Is the discrepancy between desired and actual performance important enough to warrant 
^special education intervention? 

Wliether Ricky receives service, that is, is accepted for special e'ducation program modification, 
depends in large measure on the results of these determinations. 

In this first phase of problem selection the SERT attempts to answer questions 1 and 2. 
During inte.rviews with Ms. B., Ricky, Ricky's parents, and the other people who are part of 
Ricky's school life, the SERT tries to pinpoint the performance that each desires of him. Each 
person is asked to list and establish priorities among those school problems which they believe 
require modification. Pinpointing desired performance and setting priorities for behavior change 
is what we call the assessment of the "subjective dimension" of the referral. 

The foi:ms developed to elioit information on the subjective dimension of the referral are 
keyed by circled numbers to the circled num\)ers in the matrix cell questions. They are as 
follows:* 

1. Initial referral, f i) , ^ 

2. Communication with referrer. 
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3. Conference with *-eacher (referrer). 

4. Observation and assessment schedule. 

5. Conference with student. 

6. Parent consent. 

7. Conference with parent (s). , 

8. Staffing request. 

9. Priority ranking. 

10. Case report (all data gathered in this" phase of DBPM) . 
On the facing pages, there are given brief descriptions of the purposes of the forms. 

Each form represents only one of a number of possible versions. We find our versions useful 
because they develop the kind of information on a pupil like Ricky which is important to us. As 
part of our continuing example, therefore, all the forms are completed in terms of Ricky's prob- 
lems. If you are interested in obta^ining or showing other kinds of information, you should revise 
the forms to accord with your purposes. 
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PROCESS: Communication & Collaboration 



QUESTIONS 

1. Who owns the problem? 

Are the problems those 
the teacher identifies? 



MATERIALS NEEDED 

Referral form. 0 

Procedures for arranging 
teacher conference. 
Format for teacher con- 
ference. 



ACTION REQUIRED 

Acknowledge receipt of form. 

Arrange and conduct cQn_f^r - 
ence with teacher, (i S 



Are the problems 
those the student 
i dent i f ies? 


Procedures for arranging 
student conference. 
Format for student 
conference. 


Arrange 
student 


and conduct - 
conference. Qi £5^ 


Are the problems 
those the parent 
ident i f ies? 


Procedures for arranging 
parent conference. 
Format for pangnt 
conference. 


Arrange and conduct m 
parent conference. CS 



Are the problems 
those the school 
principal or other 
professionals iden- 
t i fy? Are they 
shared problems? 



Procedures for arranr;ing 
staf fing; consul t- 
ations, ^) 



Arrange staffing; 
consul tat ion or data 
gathering by other 
profess iona Is. 



Should ether pro- 
fessionals be 
consul ted? 



Do those who iden- 
tify problem(s) 
have priorities as 
to their importance? 



Procedures for deter- 
mining priorities. ^) 



Ask appropriate parties 
to complete form. 



Summarize data on Cas 
Report Summary One. Qq] 
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Refer r al Form 

This form is used by any faculty member in the school who wishes to 
establish initial contact with the SERT regarding a student. The form 
encourages teachers to limit their initial comments to objective state- 
ments about the .social and academic behavior of tl)e student being, 
referred. Note that the referrer is continuously reminded to "be 
specific" in Identifying the areas of concern. 
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RE FERRAL FORM ^ 



Directions ; Please complete all items on top half of the form. Additional 
comments are welcomed but not required. Please leave in SERT's box. A 
conference will be scheduled within 5 days of receipt of request. 

Request for Program MoJ i ficat ion * 
To: Special Education Resource le^m 
From: Date: 9- 9- 

Grade: 3 



Re: 



Age; 9 Room #: pjOy 
Parent, Name: 



Parent, Address: /^^^A 

Reason for Referral: (Describe chi Id ' s'problem in brief 

but specific terms.) 

>/ Reading difficulty . If so, at what level does student 
currently read with 85^ accuracy? SeriesJIBld^ Book 

At what level would student have to be reading by the 
end of the year to not be considered a readl-ng problem? 
Book rj^ 

>/ Mathematics difficulty . If so, on what pages of the 
math book can the student succeed? Book Pages 

How far do you expect to go in that book by the end 
of the year? Page 

Social difficulty . Please list those specific things 
the student does, or doesn't do, which make the student 
different from clafsmat^s. 



Home Phone: 



Teacher ' s 
Comments 



I 
/ 



Other areas of academic difficulty . 
Request for Conference with Referrer 



(Be specific.) 



Please list three alternative days and/or hours during the next school 
week which would be convenient for you to meet with the Special Education 
Resource Teacher (SERT) . 





TIME 


TIME 


Monday 






Tuestiay 






Wednesday 






Thursday 






Fr i day 







COMMUNICATION WITH REFERRER 



Your application for Special Education assistance for was received on 9*^^ * 

• , name of. chi Id date 

' Sfi^T' will meet with you in J^tlZ^m^c/ut/P>^ at . 

SERT's name ' ^ " room tt ^ date tir.e 

^ Please bring any samples of work or materials which are appropriate. 

ERJC . . ' , . 7'3 



Conference with Teacher (Referrer) 

The conference with the referrer permits the SERT to clarify the 
teacher's performance expectations for students in the class. The SERT 
attempts to elicit from the teache'r (referrer) the particular behaviors 
of the referred student which the teacher views as most in need of modi- 
fication. Additionally, the conference focuses on positive aspects of • 
the teacher-student relationship and the teacher's knowledge of the 
student's interests. This information is important in developing a 
program plan. 
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CONFERENCE WITH TEACHER (Referrer) @ 

^''"^^^'Q"^- Be sure to plan for at least a 20-30 minute conference. If the teacher 
doesn't mind you may wish to record the meeting and transcribe the tape later. 



10. 



11 



12. 



13. 



If there is an academic problem pinpoint specific 
areas of difficulty. For example - if there is a 
reading problem you may wish to ask some of the 
following questions: 

a . Oral Readin<^ > 
How does the student read compared to others 
in the group? 

b. Comprehens ion . 
Does he seem to understand what he reads? 

c. Word Attack . 
Does he attempt unknown words? 
What kind of woi *5 does he miss? 
How willing is he to read? 

e. How willing is he to listen to stories ? 

2. Pinpoint specific math difficulties. 

3. Other academic areas (i.e., Social studies, 
Engl ish, etc. ) 

A. If there is a social/behavior adjustment prob 
lem pinpoint specific ares of difficulty. 

5. Are there other students who have similar 
problems? (How discrepant is he from group?) 

6. Do there appear to be any conditions which 
improve learning? Are there any specific 
classroom activities, programs, people 
which are particularly reinforcing? 

7. Are there any peer relationships which are 
particularly negative or positive. 

8. Are there any conditions which are parti- 
cularly disturbing or disruptive (evoke 
particularly unfavorable responses?) 

9^. Is there any feedback from the teacher 
regarding progress: If so, how frequent? 
Is the feedback negative or positive? Are 
there grades, check system, verbal praise? 

•How does the teacher view the child? 
a. Is he generally tired or energetic? . 
Restless or relaxed? 
Dependent or independent? 
Quiet or noisy? 

How different does teacher perceive 
chi Id to be? 

Is he aggressive or withdrawn? 
Is he popular or unpopular with peers? 
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b. 
c . 
d. 
e. 

f . 

g. 

Are there any teacher-perceived obstacles to 
performing as desired (i.e., visual or auditory 
deficits?) 

What specific kind of assistance would be' \ 
most helpful to the teacher? 

What are teacher priorities for the student? 
Have the teacher complete priority ranking 
sheet (if not completed during initial 
referral) . 



'•f r- 



Conference Notes : 

/^iicAuf 



•^y/id^<L£.\ 





Schedule for Observation ^nd Academic. Assessment 

Assessment of the discrepancy between the referred student's behavior 
and that of his peers requires multiple observations of both within the 
environment from which the referral has emanated. 

This form is completed at the end of the conference with the referrer 
and establishes set times over a period of 3-5 days for both academic and 
social behavior assessments. Three to five .days of assessment and observations 
are necessary as data are always summarized in DBPM in terms of median 
performances. 
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Directions; At the conclusion of the teacher conference complete the schedule for ^ 
observation and assessment in duplicate and give I copy to teacher and retain other 
copy for your file. 



Classroom Observation Schedule" 


Academic As-sessment Schedule--^^ 


Monday 








Tuesday ^y^^ /6'^^'/C^<^ 




9 A 7 




Wednesday ^y^^ ^ _^ ^ 




9//S' 




. ■^'^"'"'''^ 9//? 9 - 9-"^ 




Friday . 

9 /so /A //^* 




For: 




Re; 




Teacher* s Name 
By: ^£(^1^ 








SERT's Name 








'''Designate a 20-minute time period during each 
convenient for observation in the classroom. 


of 


four or f 


i ve days which wi 1 1 be 


""Designate a 30--minute time period during each 
ient for academic assessment. 


of 


three day 


: which will be conven- 
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Conference with Student 

The purpose of this conference is to give the student an opportunity' 
to express his views of school as well as to identify his areas of interest. 
By identifying interests, we may find clues to what will positively reinforce 
desired academic and social behavior. The questionnaire format used here 
is only one of many ways to conduct student interviews. 

At the intermediate and secondary levels, if a form of this type is 
used it can be distributed as a questionnaire to the entire class. When 
such a form is used in a conference, it may be advisable for the SERT to 
do the actual writing. In thn conference with Ricky, the SERT discussed 
each question with him before filling in the answers. 
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EXAMPLE OF A STUDENT QUESTIONNAIRE (FOR USE IN LIEU OF A CONFERENCE) (T) 



Date Student '^NajTie 

STUDENT QUESTIONNAIRE 

1. If I had three wishes I'd C^<Jk^ ^^^-^OnH C€^^ jdH^^^Jj^ 

2. The best thing the teacher can say to me is ^^^^^tt^C^ C4/^^hAd0t^ 

3. My favorite game is ''^Qjicti ^ijt^\^y g {Ti rCL ^ 

I like to get g^t^j fS^i- • 

5. My best friend in school is /^>\.^b^O^^^ 

6. The best place in the school is the ^ ^ ^t^^ . 

7. The school period I like best is /^l^^ f-fijd_^ 

» 

8. When I get my work done I like to ^^ - Kf^^ CjCt/f<^ 

9. The best thing that could happen to me in school is ^Ao^ \ ^^^ AA^j^m>U^_f^ 

10. If I could do anything in school that I wanted, I would ^fy/ft^^ 



H. The most fun that I have in school is 




12. The subjects I need the most help with are 

13. The subject" I want to work on first is _ ^ ' V* ^ 



If I could have help with /r^ejOLoti^x^ I would be ^^€€Lai ^ 



15. If I knew I could T^'^-lf' 1^t^<r^ ^ work on my ^ >p l^^^L^^ 

every day for at least ^ /S^ ^ ^InT^/hours . ^ 

l'6. What are student's priorities for him(her)sel f? 

Ask student to complete the priority ranking sheet, 
(see also questions 12 t 13,) 

Additional Comments: 
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6 J Communicat 



ion with Parent 



Parent Consent Form 

The concept of due process so frequently articulated by the courts 
during the last decade makes it incumbent upon all educators, and 
particularly those in special education, to insure that student's rights 
are protected. This form is used to obtain written consent of the 
parent. It fulfills the due process requirement^ of P.L. 
94-142. 

Note that the time selected for the conference was not convenient 
for Ricky's parents. The SERT telephoned after the form was returned 
and an alternate date was agreed upon. 



This conference attempts to establish a collaborative relation between 
home and school. The suggested questions are meant to pinpoint the extent 
to which the student's perceived difficulties in school are reflected in 
his behavior in other settings. 

In addition, the parent is asked to identify his/her priorities for the 
child: These priorities are considered equally with those of the teacher and 




student. 
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PARENT CONSENT FORM ^ 

Your^on^daughter ^^^C^^ has been referred to the Special Education Resource 

name ^ 

Teacher for assessment of his performance in classroom work, particularly /^ftft^Mfl ^j 

subjects , 

1 would like to meet with you on at 3'S6 to discuss ^^^UiA^lg j 

date t ime name ^ ^ 

school work. In addition, your written pern^ission to conduct this assessment is needed. 



Thank you for your cooperation. 



Sincerely, 



Please tear off and return wi th"studen t"or"Tn~ma iT 

I hereby consent to having ^I^^AkAa^ 1^ school perforraance assessed 

name 

by the Special Education Resource Teacher. 

The conference time suggested is/^^^convenient . Please call me at^^g)rwork 

to arrange. an alternate time. The telephone number is Q7SS^ 



Par'.nt's Signature 
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EXAMPLE OF CONFERENCH WI TH PARENT (S) 
1 



0 



Does the student have difficulties at home? 
If so, are there specific areas of difficulty 
that parent feels may be related to school 
performance. 

2. Are there any specific activities or con- 
ditions which cause unfavorable responses 
at home? 

3. Are-there any specific activities or con- 
ditions which student enjoys? 

k. How does the parent view thethild? (See 
teacher interview question 10.) 

5. Are there any parent perceived obstacles 
to student performing as desired? 

6. What specific kinds of school assistance 
would be most helpful* to the parent? 

7. What are parent priorities for the student? 
Have parent(s) complete priority ranking 
sheet. 



Conference Notes 




^i^ft>uu JCr ouw-^ cUr^ , 



Additional Comments: 



Date y/&<?/4!r 



Participants 
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(s) Staffing Request Form 



This form identifies the students who will be discussed by the school 
team defdgnated to establish eligibility for special education service, 
and to review the cases of students who already are being sjerved. The 
composition and responsibilities of this team vary widely. While ;he 
team approach is an accepted means of making decisions in some communities,,* 
in others, decisions are made by indivitiuals or py default. Alternative 
ways of making eligibility decisions are discussed in Chapter VI. 

Along with other students who had been referred, Ricky's name was 
included for staffing on SeptemBer 25. Approximately two weeks will 4 
have elapsed since the initial referral was completed. This is the j 
maximum time which should be used for data gathering during problem { 
selection. f 



7' 

/i 

i 5 



( ! 

t I 



*E.g.,"the State of Connecticut has legislated that Student Support Teams be 
operationalo^zed in every school in th^ state, " 
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STAFFING REQUEST FORM (8 
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Directions :, Circulate this-foroi to all members of the Student Support Team (SST). 1 
students who have been referred should be discussed within two weeks of Initial referral. 
To: Members of Student Support Team ^ 



From: SST Chairman*^ ^ 

Date 



Please list the names of all students for who.'n referrals have been received since our - 
last meeting. * ^ - ' 

Also list the names of any teachers who have requested (or are receiving) consultative 
service^for students In their classrop/DS. 

^^ M>t ^. J^ho>cLu / /^.7! J^^a^^ 



Do you know of any- students whose program should be reviewed 

or evaluated? Please list below. ^ ^ 



The SST will convene in the resource room at ' 

' time • - date 

Return this form to the SERT prior to the meeti'Tig. * 



*We recommend that the SERT chair this team. • ? 



Priority Ranking Form 

In order to determine which behaviors are judged to need immediate 
attention by .parents, student, teachers, and others responsible for pro- 
viding services to the student, each person is asked to list those beha- 
viors and 'to rank them in terms "of Importance. Estimates of acceptable 
performance levels are also solicited. 

After everyone concerned has completed the form, differences in 
priorities will more than likely be evident. How are these differences 
reconciled? Three approaches are possible: 

1. ^ "Eyeball" the data and identify those behaviors for which there 
appears to be the most agreement. 

2. Sum up all the scores for each behavior and then average them. 

3. Select tfie median number among those given for each behavior. 

What is important is not the method of ranking the benaviors of inter- 
est but, rather, the input from all concerned parties in selecting the 
problems for program modification. 

A priority form completed by Ricky's teacher is shown here. The 
priorities of all other parties to this referral are summarized in Case 
Reporf Summary One, wKich follows 
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. EXAMPLE OF A -PRIORITY-RANKING FORM 

Directions : May be attached to referral form. Ask each person concerned with student 
to complete a form. Items may be listed by the SCRT or each person may generate his/her 
own list. 

Referree- ^Q^t^cA^ Age/Grade: 3 Date: 9//o^/7k^ 

Name of person completing this form: > /^^ic** ^ C^(^^iiC^$<Ft^^ <^^M^ 

Specify those goal (terminal) behaviors which you would most like to see attained through 
program modification. 

Academi c 

.^ank - Acceptable Level of Performance 




Soc r a 1 



^ ^t^X^ 



After you complete your list, rank order the list in terms of those most requiring immediate 
attention. 




Case Report Summary 

This is the first of the Case Report Forms the SERT completes during the 
program modification. The interview and priority-ranking data are summarized 
on it. Th" report form is used in the staffing session. It also becomes 
part of the permane t record of the activities initiated to develop an in- 
dividualized program plan for the student. 
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C^SE REPORT SUMMARY ONE 



Student 
I. PROBLEM SELECTION 



Grade 











Age 


Teacher 



1 . Who owns the problem ? 

Are the problems those that teacher/parent/student/others identify? 
What are priorities? 

Summarize interview data here. 



Are the problems those the teacher identifies? /^*Z©». O^Jt^LimtiStkJ^y 













Are the problems those thr parent identifies? 




Are the problems those the student identifies? / 





CX/rt^C ...^SidonA^ J^t^€i<iA>r^ a6b€o^:^ 



other Comments 




^^^^ At^fja^M\%,Li2^ 



Summarize the priority ranl<ings here 



■ 0 TEACHER 


PAI^ENT 


STUDENT 




^eoian)or avenge 






/ 






:? 












2 






3 , 






y 












/ 


jr. jr 
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*These are different for each student. 
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Chapter V 



PROBLEM SELECTION:' MEASUREMENT 



Decision Area: 
Problem Selection 



Program Phase: 
Initial Assessment 



Overviev; 



Contents 



Overview 

Matrix questions 

Implementation 



To measure social behavior, the SERT observes in Ms. 
B.*s classroom over a period of days and counts the fre- 
quency with which Ricky and his peers (and, in some 
instances, the teacher) engage in the social behaviors . , 

that are of concern. Ms. B. has noted that Ricky is 
"always" in the middle of a fight and is very inattent- 
ive and disinterested in academics. How accurate are these statements? How much more frequently 
does Ricky engagfe in these behaviors than his peers? Due propess protections require that the 
factual basis of discrepancies be established.^ Classroom observation by the^SERT of the social 
and task behaviors of Ricky and his peers provide the oojective data needed to evaluate the prob- 
lem., I 

. In addition, over a period of five to seven .days the SERT will assess Ricky's progress and 
performance on those academic curriculum requirements which have been pinpointed as high priority 
for intervention by concerned persons. Data will be collected on progress and performance in the 
curriculum which is used by Ms. B. in the classroom for Ricky and for the students in the class 
who are judged to be "average." 

In addition to case report summaries (see Appendix B for the entire set of suggested, case 
report forms) which become part of the targeted student's individual program plan and are a 
permanent record of all actions initiated for him} the SERT summarizes the re'sults of the class- 
room observations and academic assessments on a Discrepancy Ratio Worksheet (see p. 112). 

All the behaviors for which data have been collected for the referral are listed on this 
worksheet. The SERT coji.?utes and enttirs the disct;e>ancy ratios for these behaviors on the work- 
sheet. They too become part of ^the permanent record. ' 

There are reviewed in thi^ chapter the measurement procedures which are used to identify 
desired and actual progress and performance of IRicky and his peers for six academic behaviors 
and four social behaviors identified during the cortoiunication and collaboration phase of problem 
s*j'*ection. These behaviors are as follows: 
Academic 
Progress 

1. Readins in the Read Series. • * 

. 2. Phc Holes Skill Sequence. 



See P.L. 94-142 regarding requirements for individual program plans for all identified hai\^icapped 
students. . 
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3. /Math Computation Skill Sequence. 
Performance 

2. Math Facts. 

3. Handwriting. 
Social 

Performance . 

1. Noise. 

2. Out of Seat. 

3. Physical Contact. 

4. Off Task. 
PROCESS: Measurement 



ERIC 



J? 

o 

O _ 

t«>S CO 

^ to 
Co ^ 



QUESTIONS ' MATERIALS NEEDED ACTION REQUIRED 

2. Is there a discrepancy Curriculum materials used 

between desired and actual in r.eferred student*s 

performance? class. 

Are there desired academic. Procedures to collect data Collect data on desired 

progress expectations? on desired progress for , progress for average 

average students. (^ '' students.. ^ 

Are there desired academic Procedures to collect data Collect data on academic' 

performance expectations? on desired performance for performance of average 

average students. Q students Q) 

Are there desired expect- Procedures .to collect data. . . jQoll.ect baseline data 
ations for social behav- on social befra\^ior of V f '^Qn.soc^^j behavior of 

[^[l ^ , .average students?; '-^^./j-r^' average students. 

What is the target stu- Procedures to collect data Collect baseline data orr 

dent's actual level of on actual academic pro- academic progress of 

academic progress? ^ ^ess of target student. target student. Q 

"--•T ^ ^ _ _ _ _ 

What is the target , Piocedures to collect data Collect baseline data on 

student s actual level on actual academic perr academic performance of 

of academic perform- formance of student. Gj target student. t5i 
ance? 

What is target student's Procedures to collect data Collect baseline data on 

performance in social on social behaviorof taroet student's social • 

behavior? target student. behavior. Q) 

What is the discrepancy Procedures to graph data Appropriately title and 

on desired and actual ^ label graphs^PJot data 

progress/performance. . on graphs. @ 

Procedures to compute^ Compute discrepancy ratio 

discrepancy ratios. Q) and record on worksiieet. 

Q 

Is there, data on Cumulati"e folder data. Summarize data pertinent 

nfrforT'"? ^ '° P"""^"^ Priorities and 

performance? . proble.ms. ^ ® 

Summarize data on Case 
Report Summary Two. 

^ Circled numbers are keyed to sections of chapters. 
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Progress measures focus on the 
time it is taking a student to master 
an ordered set of instructional ob- 
jectives for a particular curriculum . 
(see Chapter III). 'The rate at which "average" students master these objectives represents desilied 
pr^ogreas. The procedures for obtaining this information are detailed in the following steps: 
I^TEP I ( Determine criteria for desired progress. « 

' a. The best method for determining the progress that is desired for average 
students in a particular class in a particular school building is to ask the 
teachers. Generally, they can specify the minimum expectations for students 
who have been identified as progressing at an average rate in the curriculum 
of interest. The specifications should be in the form of a list: the se- 
quence of objectives (ordered according to complexity) and the approximate 
completion date for each. 

b. If the teachers cannot agree^ on or are unwilling to specify progress 
t-..)ectations for average students, then the criteria established by the , 
school district for minimum progress requirements should be used. 

c. If minimum progress expectations for average students cannot be ob- 
tained from the teachers or the school distric-, use the criteria for pro- 
gress which have been established for the curriculum of interest by the 
curriculum developers (e.g., scope and sequence charts published for a 
i^eading series), if such information is available. 

I STEP 2 1 Select and label the progress graph. 

a. > Depending on the length of the curriculum (i.e., 1 year, 2 years, 
6 years, etc.) select the appropriate progress graph and mark the abscissa 
in equal time unics (see Graph 1, ( hapter-III) . 

b. On the ordinate,, list the sequence of material or objectives through 
which children are expected to progress (as .determined by the criteria 
obtained for the particular curriculum) according to the month and year in 
which the average student is expected to complete each uhit of the material. 

c. Draw a diagonal line through the intersecting graph lines, frori left to 
right to represent average progress through the period of the curriculum. 

IaPPLICATIoT] Examples A, B, and C show the application of the p-ocedures discussed in 

Stept> 1 and 2 to three curriculum sequences at River Run School by the class- 
room teachers and the SERT. The curricula are the Read Series, Phonics, and 

Math. Graphs 12a, 13a, and 14a have been labeled to show the desired progress 

for each sequence. 
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I STEP 1 I 



EXAMPLE A: Determining Desired Progress, 
Read Series, River Run School 



Determining criteria for desired progress. 

The mastery sequence for the Read Series (Fig. V-l) is based on the 
publisher's estiirates for j:ompletion of each book. This sequence was ad- 
opted to estimate progress for the average students because, over the years, 
the teachers hSti^ observed that average students completed .the books at 
approximately the suggested rate. 
Seleatzng and labeling the progress graph, 

a. Since the curriculum takes an average of six years to complete, a six- 
"y^ar progress graph was selected by the SERT. 

b. The SERT labeled the ordinate axis with each book/level initial at the 
month indicated for mastery (Fig. V-1), and the abscissa, with the school 
months and years. 

c. Since average progress is one month of progress for one month of time 
in school, a straight line was drawn through the intersections of the 
horizontal and vertical lines from the lower left-hand corner of the graph 
to the upper right-hand corner. The result is shown in Graph 12a. 



Grade 1 : 

^nd So You Go 
Be on The Go 
^an You 
£ays and Ways 
Jach and Al 1 


.Approximate Completion Date 

October 1 
December 1 
January 15 
March 1 

June (End of School) 


Pages 

72 
100 
190 
222 


Grade 2: 






^ar and Away 
Gold and Si 1 ver- 


January 1 

June (End of School) 


252 
282 


Grade 3: 






_High and Wide 
Ideas and images 


January 1 

June (End of School ) 


295 
296 


Grade 4: 






jJoys and Journeys 


June (End of School) 




Grade 5: 






Kings and Things 


June (End of School ) 




Grade 6: 






Launch ings and 
Landings 


• 

June (End of School ) 

«. 





F»g- V-l. Expected progress for average students for Read Series (Ai 
Book Co., 1968), River Run School. 



01 



imer i can 



STUDENT: 



SCHOOL: 



J^Xn>4^ /^MU CURRltULUM /^Jl/Pt^ jle^'fUsAJ 




TIME IN SCHOOL ( YEARS ) 

Graph 12a. Six-year graph showing expected progress for average students for Read Series 
(American Book Co., 1968), River Run School. 



STEP 1 



PsTEP 2 [ 



EXAMPLE B: Determining Desired Progress, 
Phonics Skill Sequence, River Run School 



Detemining criteria for* de aired progress , 

The progress sequence for phonic skills (Fig. V-2) is adapted from the 
Gallistel-Ellis Reading and Spelling Sequence (Note 1). The teachers 
decided upon thij number of skills to be ma^'tered each year and the mastery 
dates according to tne phonic skill sequence in the Read "Series . 
Selecting and labeling the progress- graph. 

a. Although the curriculum is only four years in length the SERT used 
a six-year progress graph to match the reading graph. 

b. The numbers representing cumulative skills were placed on the ordinate 

at the months and skills at which the average student is expected to have mastered 
these skills. 

c. The average desired progress line was drawn through the intersections 
of the time-of-hastery and time-in-school lines for the four years of t\xQ 
curriculum sequence; average desired progress = one month of progress for 
one month of time in school.. 
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GRADE 1 

1. C VC ( a) 
(b,s,f ,m, t) 

2. C VC la) 
(h,j,n,p, I) 
(b,s,f,m, t) 

3. CVC (a) 



(r,hard-9,d) 

" CV C (a) 

Thard-c,k,ck,nd, 

-5. CVC (a) 

(All single 



consonants 
except v,y,x,z ) 

CVC (i) 

(b",c,d,f,g,h,j, 
k, 1 ,m,n,p,r,s, 
t ,v,w,x,y ,z;ck) 

CVC (a-i) 



GRADE 2 GRADE 3 

18. CCVCC (a-i- o) 2 

(beg. blends: 

st,sc,sp,sk,sl, 
sw,sn,-m,bl ,ci , 
^ 4 fl,gl ,pl,sl ,br, 

OCT* J cr,dr, fr,gr,pr, ^ 
tr,thr,shr,sw,tw, 
dw,qu, kw) 
(diagraphsrch ,sh, 
th,wh) 2 
(ending blends: 
1 1 ,ck, ss,nk) 

19. CCVCC (a-i-o) ^Ary. 

(beg. blends: 
scr,spr,squ,str, 
.OeC.I spl) 

(ending blends: 
ng,sh, 1 1 ,nk) 



(all single 
consonanis) 

8. CVCC (a-i) 
(ck,ss,ff , 1 1 ,zz) 

9. CVCC (a-i) 
( ing,ang, ink, 

ank) 

id'. CCVCC (a-i) 
(sh,th.ch,wh, 
ck,ng,nk) 

1 1 . CVC (o) 

(all single 
consonanis) 

M2. CVC (a-l-o) 
(a) 1 single 
consonants) 



20. CVCC 
21 



(a,e, i ,o,u) 



y and e 

(at the end of 
one syl lable 
words) 

FtK|22. Magic e 
(s ing! e 

consonant) | 

23. Magic e 
(double 
consonant 

JW.I '^t-^tzk. Soft c and g; 

-(tch,dge,ge, 
nge,ce,nce: 



28. 

.29. 
=^■•■•30. 

31. 



cvvc 


(ai',ay 


,ow,oa 


oe,ee 


,ea,ui 


ue, le 


, igh) 


ccvvc 




(ai ,ay 


ow , oa , 


oe,ee 


ea,ui 


ue, ie 


igh) 


CVVC 




(00, ou, 


ow,au. 


aw , 0 i , 


oy , ew , 


eu , a 1 1 


. alk) 


rrwwrr 

V V l« l« 




(00 , ou , 


ow, au , 


aw , 0 1 , 


oy ,ew, 


eu,al 1 


,3lk) 


r wi th 


short 


vowe 1 s 




r with 


long 


vowe 1 s 




ccvvcc 




(ie,ea. 


neigh. 


augh, i 


nd, i Id 


old) 





GRADE k 
33 



Closed syl- 
l ables wi th 
y and (c) 
le endings 
and wi th 
2nd closed 
syl lables 

Two closed 
and open s vl' 
labi es wi th 
^ y,ly, le,s, 
es,ed ,er , 
est , 1 ng 

Soft c and 
g i n two 
syl lable 
words 

Pref ixes : 
(a,al •ad,de, 
ex, in, re) 
Suff i xes: 
(ar,er,or, 
t ion , s ion , 
ness,ment) 

37. Multisyl 



3^. 



35. 



36. 



32. (wr,ph,kn,gh,gn) ^U^lt 



lable words 



13. CVCC (o) 

(ck,n) 
1^. cycc (o) 

(st,ff ,ft,ng, 
th,ss) 



^ April 



15. CVC (a-u) 

16. CVC (a-e) 

17. CVC^ 



a-e- 1 



-o-u) 



Fig. V-2, 



Expected progress for average students In phonics skill sequence, grades 
1-^, River Run School. (Adapted from "Phonetically regular wordsffor 
use in teaching and testing both reading and spell ingj/' by B. GalHstel 
5 E.K. Ellis, ' Reading and spelling c^atpgories. H'inneapol is. Minn.: 
Department of Psychoeducacional Studies, University of Minnesota, 1970.) 
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STUDFNT: O.'X*.,,^t.0M, 
SCHOOL: A4i%*^ Vlu^ 
:URRICULUM: ^>J,,o^^^ 



Graph 13a. Progress graph for average 
students for ^-year phonics 
sequence, River Run SchooK 



i2>4>»rt i2>4»»rt i2>*»»ri w>«s»ri ii)4»»ri ii>««»7* 

TIME IN SCHOOL (YEARS) 



t STEP 1 I 



I STEP 2 I 



EXAMPLE C: Determining Desired Progress, 
>Uith Sequence, River Run School 



Detemining criteria for desired progress. 

The progress sequence for math computation skills shown (Fig. V-3) and the 
approximate dates for completion had been derived by the teachers during a 
series of weekly meetings. ' ^ 

Seleoting and labeling the progress graph, 

a. For a six-year sequence, the SERT selected a six-year progress graph. 

b. Tiie numbers representing cumulative skills were placed on the ordinate 
at the month and year at which the average student is expected to have 
mastered these skills. 

c 

c. The average progress line was drawn through the time-of-mastery and 
t ime-in-school lines for the six years of the curriculum sequence; average 
progress = one month of progress for one fnonbU'^D^ time in school (see Graph lAa ) . 





STUDENT : ^C/t^</l^<tA^ 
SCHOOL : ^H/U4/9^ TXJU^ % 
CURRICULUM: J^at^^ C^^yQ4JkjLo^ 



i 



Graph i^a. Six-year progress graph 

for Math Computation Skills, 
River Run School . 



TIME IN SCHOOL (YEARS) 
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1. Add two ont'diott nuobers; sums 0 4 0 to 3 -f- 0 

2. Add two one*dlgit numbers to sow exactly ten 



3. Subtract ooe-digit niviber from one-digit nurnbor: 0 - 0 to 3 - $ 
^. Subtroet 0 thrc >9h 10 from 10: 10 - 0 to tO *10 
Cradt 2 



JAN.I 



5* Add three one^diglt numbers; suns 0-^0-^0 to 3-^0-^0 

6. Add two one-dig! t numbers to sums of It through IS 

7> Add three one-digit nunbers to sun 10 through IS 

8. Add tens fro<a 10 ^ tO to SO > 10 

S* Add a one-digit number > d two-digit number without corrylng 

^tO. Add * two-digit number to * two-digit number without carrying 

11* Add three two-digit nunvbers without carrying 

\2y Add 0 one-digit nivnber to o two-digit number; sums 10 through )8; 
wl thout carry ing 

13. 
Id. 
15. 
16. 



Add a two-digit number to o two-digit number wiTK~orrylng from ones col usn 

Add three two-digit numbers with carrying frofn ones column 

Add tv<« tw-digit numbers; corrying from tens column 

Add two two-digit numbers; carrying from ones ond tens column 

17. Subtract one-digit number from two-digit number without borrowing 
combinations of M through l8 ( M - 2 to 18 - S) 

t8. Subtract combinations of tens: 10 - 10 to SO - SO 

IS^' Subtract one-dlgit number from two-digit number, rcmembflng to bring 
down the one In the tens column: II - 1 to IS - S 

20. Subtract two-digit number from two-digit nui)ber without borrowing 

21. Subtract one-digit .lumber from two-digit number with borrowing 

22. Subtract two-digit number from two'digit number with borrowing 
Grade } — 

23< Add three two-digit nu«>>ers; c^trrying from t>oth onts .^n<i tcn\ coliKvi 

2U. Add hundreds: 100 * 100 to SOO * 900 

2&. Add two three-digit numbers witliout carrying ^ 

26. Add three ttvfoe-digit numbers without corryinq 

27. Subtract two-digit nunber from tl>rr«— digit niimh»fr with borrO'/^Jn'j f ro^ 
hundreds column (cvily) 

28. Subtract two-digit number from three-digit number with borrowing from tens coluim (only) 
2S. Subtract hundreds trom hun<|feds: 100-100 to SOO-SOO 

30. Subtract three-digit number from Chree digit number; no borrowing 

31. Hultiplication Facts - 2's 



JAW. I 



JUNE! 



32. Multiplication Facts - 3's 

33. Review Coal 

3d. Hultiplication Facts - d's 

35. Multiplication Facts - 5's • 

36. Review Coal 

37. One Place Multiplier - 2 place multiplicand no carrying 
Grace d 



Add two three-digit numbers with carrying from ones colum only 
3S. Add two three-digit num&er? with carrying froatens colucv) only 
do. Add two three-digit numbers with carrying frcn both ones and tens colusnt 



F£Q.\ 



JUNE i 



ERIC 



fig. 
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v-3. Expected progress for average sudents In »dth computation skill*, grades |-( 



dl. 
d2. 



Subtract three-digit number from three-digit number; borrowing from ten* ioluen 

Subtract three-digit nun^r from three-digit number, borrowing from 
'rom hundreds column only 



d3. Subtract three-digit number from three-digit number; borrowing from 
tens and hundreds columns 

dd. One place nultlpl'^cr - 2 place nultiplicand carrying in hundreds column 

d5. One place multiplier - 2 place multiplicand cjrrying In tens column 

56. One place multiplier - 3 place nultiplicand carrying in tens column , 

d7. One place multiplier - 3 place multiplicand carrying in hundreds column 

^8. One place multiplier - 3 place multiplicand carrying in tent and hundreds colum 

dS. Two place multiplier - 2 place multiplicand no carrying 

50. Two place PHiltipiier - 2 place muitiplicand no carrying 

51. Two place multiplier - 3 place multiplicand no carrying 

52. Multiplication Focts - 6*s 

53. Multiplication facts - 7's 
5d. Rev lew Coal 

55 Multiplication facti^- 8's 

56. MjI t ipl Icacion facts - S*^ 

57. f<eview Goal 
Crad» S 

58. Two place multiplier - 2 place multip"cand carrying «n tens coluwi 

59. Two place rwltlpller • 3 place mul t ipl Icaf.d carrying in tens colum 

60. Oivision Facts - 2's ^ 

61 . Oivision Facts - 3's 

62. Review Goal - 2*s and 3't 

63. Oivision ^acts - d's 
6d. Oivision Facts - 5's 

65. Review Co^l - d»s and 5'* 

66. Oivision Facts - 6's 

67. Olvlsiofi ^acts - 7's 

68. Review Cocl ■ 6S »nd 7*5 
6S. Olvlslo'i fbcli - 8S 

70. Oivision Facts - S't 

71. Review Coal - 8*s and S'^ 

72. Two as divisor <- 3-digtt dividend 

73. Two to nine as divisor - 3-digit dividend 
Crade 6 

7d. Th^-ee place multiplier - 3 place multiplicand carrying !«, tens and hundreds coluan 

75. Three place multiplier - 3-d place muitiplicand - 0 In tens column In eultlpUor 

76. Two as divisor - 2 digit dividend with rem*ln<*er 

77. Tho to nine as divisor - 2 dl^lt dividend with remainder 

78. l-digit divisor'- 3-rflgit dividend with remainder 

79. Two and three-digit quotient with zero 

80. Tens as divisor - with no remainder 

81. Tens as divisor - with remainder 

8?. Two-digit divisor - three or four-digit dividend without remainder 

83. Two-digit divisor - three or fwr-digit dividend with remainder 

8d. Three-digit divisor - three or more-dlglt dividend with remainder 



River Run School* 
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. (2) Determining Actual Progress of Target Student 



After the desired progress'' 
in the school curriculum of irfter- 
r est has been, established, the SERT 
^ must determine the target stu- 



Here are the procedures for obtaining this information. 



dent's mastery level for this curriculum 

\ STEP 1 1 Select material.. 

From the books used in the curriculum, select, at least three but prefer- 
ably-more samples of material at each level which the target student's average^ 
classmates, have mastered at the rinje of testing. 
i STEP 2 "I Collect the 'data. " ' « . ' ' " .% * 

a. beginning with selections from the highest mastery levo-l.achieved by 
the target student's average classmates, present the tkree or. more samples 
CO tlift student. v . 

b. t'or each sample, rec^oird the student's frequency and apcuracy of 
responses. >v " 

c. Count the frequencies of correct and incorrect responses to all the 
samples. 




t STEP 3 I SwmaHze, 




ita:r 



US7 



^^^T^^J^^ iUsc^es in order, from low -to high, 
m^'^e the median^cores for correct and incorrect responses. 

yte^ry and instimctiorial level. 

G target student's median scores meet the established criteria 
"present samples to him from successively higher levels of the 
lfua.uj until he reaches his instructional level. 
h. ^If^ the m^^ti $cores do not meet the established criteria for'mastery 
at titt lovjj^^^mpled, continue to sample at successively lower levels until 
???f[t??^.^X^v^'^'^*^*^^^^^^ instructional level can be identified. 

instructional level is one level above the mastery level. For 
some ^^tudents, this level is thq "frustration level," that is, the point at 
which the student becomes frustrated and does not learn- Whenever a "frus- 
tration level" is encountered, begin instruction at the highest mastery 
level and sample frequently from the next higher level unti^ the student ' 
can move into it without frustration. 
i STEP 5 ) Plot rrnsterij level for target student and average peers on the progress , 
graphs. ' . . ' ^ 

The target student's mastery level is plotted on the graph with a O at 
the intersection of the mastery level on the vertical axis and the current . 
.^P> Ji^l^-^ ---2^^^^ ^^^^ month on the hori;:ontal axis. A A is plotted on the same 
^^^raph ^^o^show the desired progress for the student (equivalent to expected 
^-^^^tjgtess for the student's average, classmates at the same point in time)- 





/ ^'y ■ f'^^^p ^^^^ two points are on the same vertical line. 

'^ r^^9::6 j fi Drm a nonintervention progress line. * 

Wliat will be the target student's mastery level at the completion of six 
f school if no instructional intervention changes his present rate 

97 • 
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\ 



of progress? 

i:he answer can be demonstrated graphically by estimation orl projection., -SUngVan— 
equally .Spaced broken line, connect the point representing current mastery, ^. 
JljeAOJl^ to the zero point (le£t-hand lower corner) of the graph; i 
changing the angle, carry the line out to the vertical line /rep 



/■ 

then, without 



esenting' th^r^ - 



|application| 



ess that 
planned and 



ninth month of the si^th year. This dotted line shows the prog 
can be anticipated_f or the target student if no intervention is 
implemented. 

Xherc follow th^ee examples (Al, Bl, CI) of the application ^of these y 
procedures By the SERT Co the assessment of Ricky's mastery levels iiVj^%>s^— -^'^ 
Read Series (American Book Co.), phonics skill sequence, and math skill 




sreque^n^ce. 



EXAMPLE Al: Det^?rmining Ricky's Progress 
in Che Read Series 



/ 



i STEP Selecting the mateHal. ' , ' 

a. ' The SERT chose three selections at random from each third of every 
book in the Read Series tlirough the third grade. Each selection was 150- 

; 200 words in length. ' , ^ 

b. Five comprehension questions were written for: each selection using who, 

what, when, where, why, and how questions. A, sample reading selection and 

* * - \ 

questions. are Shown in Fig. V-4. . \ 

. JiSTep V I Colleotwa the duta. ' ' • ' 

a. The SERT identified Book G a?: the higUcLSt mastery level which 
Ricky would have achieved if he were progressing , \s -desired (sed Graph 12a). 

b. Ricky was ,asked to read "the three selectio^^ from this level; for each 
selection, the .SERT timed him for one minute and recorded correct and in- . 




correct responses 
c 



For each selection, Ricky was asked .the five previously selected 

comprbhen.*?ion questions. The SEUT recordxixj^ correct and incorrect lesporise^. 

I STEP 3'1 SummaTizing"\he'dat€u ■ ' ' : 

'* - - . ' _^ 

a. The SERT, totaled the number o£ cotrect and incorrect words read/minute 

for each serect;ijon. - . ^ ■ 

b. The number comprehension question's answered correctly was totaled 

and the perc<intage^found, as follows: 

% of cfuastions 'answered oovreotly 
I * total a of^ questions, , " 

; c. The data for the selections were or^^red^from high to- low and the 

medians were"»^liicted. These are Ricky's fading and comprehension scores 
for tli'e Read Series. 
/ I STEP I Dehemining mastery^ ahd-ikiyt^ctionar iedels. 

^The crit-eria estabJished at iHvQr Run School for determining mastery, 
^ frustration, and iTr^tTu'ctional levels, for grades 1-3 and grad.es 4 and above - 



= % correct 



follo}fe'figui;e V-tiy 



ERIC 



I 




\ - 



LeVe,! C 

Total /Words = 168 
Score^Norm = Not more 



than 2 errors- 



/ 



»BUGS 



Bud /ran up to Ha) and said» ''What /are you 
doipg?'> /. 
"I am trying to see if l^can get /a bug," 



hit 



Bud said. 
' -"A bug?" said Bud. "Wh^t for?" 
V-'VNot a bug," Kal said, "Bugs! /Kneed a let 
of therii." / 
"You do? Why?" said Bud 
*And Hal said, "1 need bugs so/ I can go 
. f ish ing." 

, "May I. go fishing with you?"^said Bud 

"You may if you can g'etv>^^LCugs," Ha) said. 

We need a )ot of themf^'^ 

So Bud s^at with HaJ." He w^s trying to get 
' bugs' to go fishing. 

"Say! Bud said. "This is/ fun 

Trying to get bugs for fi/shing!" 

"Yau said it!" said Hal. 

"I got a bug!" said Bud 
^ got a bug!" 

"Show it to me!" said ^a 

He saw it and then he .isaid, 

"That is; r^t a bug." / 

")t is SO' a bug," Bud/ said. ; 
^^It. is not," Jsaid Ha/. 

")' know a bug- when -*)/ see a bug 
. And THAT is not a bii^."* 



)0 
)) 

22 




30 
^0 
k2 
A7 
57 
58 
66 
76 
82 
92* 
96' 
)02 
)08 
113 
119 
123 
129 
136 
11 

148 
153 
^62 
168 



Comprehension Questions 

f 

What did Bu^uask Hal? 
("What axJiV^i^^«ff§V') 

What did Hal say he was doing? 
("Trying to see if I can get 
a bug.") 

How many bugs did Hal need? 
(A lot of them.) 

Why 'did Hal need bugs? ""^^^ 
(So he could go fishing.) 

How do you know that Bud 
wanted t;o go fishing with Hal? 
(He asked Hal if he could go 
along.) 

What did Bud have to do so lhat 
he could go fishing with Mai? 
(Help get bugs.) 

What did Hal want to see? 
(Bud' s bug. ) 

What did Hal and Bud argue 
about? ^ 
(Whether Bud really had a bug.)» 





ERLC 



Fig. V-'i. A rand6m)y se)6cted samp)e from Leve? C, 
and comppehens ion questions. 



B^ad Series (American Book Co.,* 196&), 



Frustration Level 



29 Vor^^s/min. or lessf 


and/or 

less \han 80% com- 
V prehension 


-/ 




and /or V 




8 or more^^rrors/mi 









Medians: . Grades 1-3' 



Iris t rue cional Level 



' 30r49 wdr<ds/ml.n. & 




^80% comprGhension 




and/or 




3-7 errors/min. 




. 99 , 









^^^"^^-^--Mar^ery Level 



50^words/min. & 
80% comprehension & 
2 or fewer errors/min. 
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Frustration Level 



Medians; Grades 4 and Above 
Instructional Level 



49 words/min, or less 
and/or' 

less than 80% comprehension 
and/or 

8 or more errors/min^, 



50-99 words/min. & 
80%^ comprehension 
and/or 

3~7 errors/min. 



^tastery Level 



100 words/min. or better & 

80% comprehension & 

2 or fewer errors/min. ^ 



The rates used are 'based on minimum guides to decision making in oral ^ 
reading established by Starlin and Starlin (1974) through observation of public school 
children of all ages. Criteria, for mastery also may be determined by sampling 
the performances of average readers from each grade in grade-level reading 
material. 

3 Ricky did not reach mastery level in selections from Book G and, therefore, 
the SERT continued to sample at successively lower levels in the Read Series. 
In Book Ricky reached mastery level in the first two selections and 
instructional level in the third selection. It was decided to place him at 
page 60 of the C book (approximately two-thirds of the way through) rather 
than to begin with Book D, however, since his error rate in Book D was more 
than 8 per minute (frustration level). 
^ I STEP 5 I Plotting mastery level on the graph for target Btxtdent and veero. 

Ricky's mastery level was plotted on the graph with aO^t the ijTitcrseccion 
of the lines representing approximately two-thirds of Book C on the vertical 
axis (4 months of grade one) land the beginning of month one of fhird grade on 
horizontal axis . , 



the 



i 



Desired progress for Rick> 
section of the lines represei 



STEP 



3 



was plotted on the graph with a/iat the inter- 
ting beginning of^ month one of tliird grade on 

both the vertical and horizootal axes. i 

r 

Drawing the nonintervention progress tine. . « 

The broken line in Graph L2b as drawn by the SERI.,^ represents Ricky's 

projected mastery level at the completion of six years of school if no 

k * ■ 

instructional intervention were to change his present rate of^ progress. 

,The last point intersects the last line of the graph iit one year and 3 months 

of progress (12 months). 



EXAMPLE Bl Determining Ricky's Actual Progress 
in the- Phonics Skill Sequence ^ 



3 



I STEP 2 I 



ERIC 



Select the matertal. ■ . - 

s» The GERT prep^ired three selections of 100 items or more In lcn>5th 
comprising approximately equal numbers of words fromthe third-grade cate- 
gories of the skill sequence and eath category preceding it. Samples of 
items from categories 1, 2, and 3 (j^ee Fig. V-2) arc^ shown in Figure V-5 
Collent the data . , ' , 

a. The SERT..identified category 24 as mastery leva! for Ricky were he. 



/ 
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(The; lad ran (to) Dad. 

Dan had a rag bag. 

(The) bad rat sat (on) a hat. 

Dan ran (to), fan (the) man.' 
Nat ran (to)! (the) pan. 
Pat (is) mad at (the) rat. 

(The) rag bag has a gap. 

Dad has a dap (of) ham. 

Sam had a nap (on) (the) mat. 
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~{ ) indicates sight word 



Fi^. \l-5f Samples of isolated words and v;ords in context from categories 1, 2, and 3 in 
, phonics skill sequence. The cumulative total words »for each part are given in 
1' the ri'ghfc-hand columr)^ 



progressing as desired in the phonics sequence' (see Graph 13a). 
, b. Ricky, was asked to decode three selections from category 24 as the 

/ SERT timed him for one minute and recorded correct ?n*d incorrect responses. 

l \ STEP. 3 i SwmaHze the data. f'" '.^ ' " 

a. . The SERT totaled the number of correjit and incorrect words decoded/ 
minute for each selection., ' » ^ - 

b. The data for each selection. \*ere'^ordered from high'to low and the ^ 
medians were selected.. The medians .are R&ky's <^orrect and incorrect rates/ 
minute of decoding for category 24 of the phonics se'cjuence^ . , . 

( step 4] DeteiVTfine mastevy and imtyuctional level, ^ 

The criteria established at; River j^un 'School for det'^rmining mastery and.^, 
instructional levels in phonic decoding skills are as follows: . , 

Medians: Grades 1-3 , 



Frustration Level' 



Instructional Level 



Mastery Level 



29 words/min. or less 
and/or 

8 or more. errors/min.* 



30-49 words/min. 
and/or 

3-7 errors/min. 



50. words/min, or better & 
2 or fewer errors/min. ' . 



Frustration Level 



" Medians: /Grades 4 and above 
Initructional Levfel 



Mastery Level 



.49 words/min. or less 
and/or 

8 or more errors/min. 



50-99 words/min. 
anc|/or 

3-7 errors/min. 



100 words/min. ^r better & 
2 or fewer errors/min. 



Ricky did not /attain/ mastery level in category 24. Therefore, thf» SERT" 
continued to sample from successively lower levels of the sequence. Ricky 
attained mastery/ level/in categ^ory 17; thus, instructional level was deter- 
mined to be catdgor-y l/s. _ 



i STEP 5 I 
• / 

I 
/ 

I STEP 6 I 



Plot mastery lejel OHithe progress gra^h for Ricky arid hij peera-^ 

On a progress graph, the SERT plotted aO at^ the intersection of the lines 
representing categorJ 17 (9 monthsof .progress), on the vertical axis and 
month one of grade 3/on the horizontal axis, and a 6 at the intersection of 
the lines representi^ig month one of grade -3 on both axes (Graph 13b).' 
Drai) a nonintexn)entijon progress tine. ' 

The nonlnterventjLon progress line,' projected from Rilcky-'s actual current 
mastery level, intersects the last line oC the 4-year fekill sequence at the 
point representing 'one year and 8 months of progress.,^ The SERT concluded that 
without intervention, Ricky would master ILttlc more ^than 17 months of the 
phonics skill sequence during the elementary school vijars. 
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Graph 13b. Klcky^s actual mastery Iqvel in phonlc^i skill Sequence in relation 
to desired progress and estimated, nonintervention progress. 



\ STEP 1 I 



I STEP 2\ 



\ STEP 3| 



EXAMPLE qi; ^Determining Actual Proi;rosa for Ricky 
> In the Math Skill Set^uence^ 



Select the !r.ateH<xln. 

a. The SERT prepared three sets of at least 25 problems for each category 
of the skill sequence. Each set included at least five problems frvui tihe 
target category and one problem from each of the preceding categories. A 
sample of the set for category i9 ts shown in Figure . . 

Collect the delta* ~ , ' 

a. The SERT identified category 22 as mastery level for Ricky were he 
progressing as desired in the math skill sequence (see Graph lAa). 

b. Ricky was ajs^^cd to write answers to three sets of problems"^f ronv 
categ ory 22 while the SERT timed Vilrn for one minute. 

SimnaHzing data* . ' ^ 

a. The SERT totaled the number of correct and Incorrect digits written/ 
minute in sequence. For exailmple, in the prcblem 20 + 35, if the student'/V 
responded 65, one digit would be counted an written lorrectly and out* dlgic , 



ERLC 



Willie the Read Series app^roacb is used te-uh reading in the vast najurity of olemenCary 
sc hools in th e .United S'tates, mat I) skills are m> tcjrequently assessed and taught using 
objectives in a skill sequence. Therefore, ^ml.. *h it would be possible to randomly 
select inatli problems at each level of a basal math series, measure performance , and place 
the student at an instructional level in a graded math book, for present purpuses we only 
determine progress in the skill sequence. 

• ■ . ■ • . . ifiJ - " 




Fig.: V-6. .Random sample of five problems from category 19 and one problern from each 
preceding category. 



as written incorrectly. If the student responded 50, the answer would be ^. 
counted as no digits correct and 2 digits incorrect. In a problem such / 
as 34 + 29, if the, student's response were 63 and he had placed a 1 over the 
» 3 to indicate cartying, the answer would be counted as three digits correct 
Cthe mark made to indicate carrying would also be counted as a digit')./ ' 

This method of r.ecording correct and incorrect responses in math is 
based on the wo rk ■ o f-pretri'pion t -eatH ier s (H aughton, 1971)." Recording move- 
ments/ninute rather than number of total responses coijrect/minute decreases 
the risks associated with treating all problems as being of equal length 
and complexity when, in fact, the profblems vary in the length of time 
* needed for completion because of variations in the number of ^operations 

, , - required and- the ^number of digits in the written answer* 

b., .The total correct and i^j/orrect responses for each set of problems 
were ordered from high to low and the medians were selected. The medians 
are Ricky's correct and incorrect ratss/minute for'computing .math problems. 
I STEP 4[ 'Determining mastex^y and ins,tvuotionat level '. ^ 



Here are the criteria established at River Run School for determining v 



mastery and instructional" levels in math computation skills. 
Medians: ferades 1=3" 



Frustration Level 



Instructional Level 



0-9 digits/min. correct 
and/or 

8 or more digits/min. 
incorrect 



10-19 digits/min. correct 
and/or 

3-7 digits/min. 
incorrect 



Mastery Level 



20 or ;nore digits/min. 
correct & 

2 or fewer digits/min. 
incorrect 




"J 



Fru\;t ration IsgvgI 



6^I9"*digits/min. correct 
vand/pr - 

8 or- more ajgits/min. 



incorrect 



Medians; Grades 4 and above 
Instructional Leve 1 



20-39 digits/min. correct 
aiyj/or 

digit,s/min. incorrect 



_ Mastery Lovol 



40 or more, digits/min. 
•correct & 

2 .or fewer digits/min. 
incorrect 




\ Rirk^Jdid not achieve^at; mastery level iin the category 22 problems. 
' ' TlWi!<f^?re, tfie SERT continued, to sample from successively lower levels 
-Yn Airt^-'o/ini^.THA ..wif^-i T>^oi>,v achieved at mastery level in category 2» 



.„'.v-duVvOlP^1'scQifi^^ce uitLil* Rickj' ach 
^rl>7* ^if^^^i^xl^^'^na^^ was determi 

^^^^S^^^^±!S^'€v^elG for target student and peers, on the prpgveoQ. gvaph. 



rmined ^:o be^ category 3.. 



Usin^ .a^^. the SER^F .i)locteU Ricky's present mastery leyel at the inter 



sectic/h af the Jines 



representing achievement of pb^ectlye 2* (5 months of 



*^>rf^gi:ess) oh* the vertical axis and beginning of third grade on. the horizontal 
axis (Graph 1415).-, ^ w , • , ^ ^ 

jsTEP 6 1 '\i)vaw the noninterveyitj.on ^pogress line* ' ' ' ^; 

Using Ricky's present. master^TIeveX ns the focus, the SERT drew a projected 
progress line; it intersWted the last, line of the graph at one year and 
5 moivchsv The SERT concluded that if Ricky/s present rate of progress were' 
not altered by int .■rvejj(( ion, he would most probabiv achieve o^iJy 14 months 
of progre.J5s in the maih skill sequence by the rompletiOn of six y<tars of 
school. * ' J * * 
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TlfylE IN SCHOOL ( YEARS ) - . 

Graph l^ib. Ricky's actual mastery level of math skills in relation to desired 
level and estimated nonintervention progress. 
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Determining Hcsiicd Academic PeTormance nj 
for Target Student ^ 



1 



Performance measures, as dis- 
cusse<L.ln Chapter III, focus on the 
individual level of prof iciency in ^ 
single tasks. Although performance 

on tasks may be stipulated by the culture, for school tasks we think^it is preferable to determine 
desired performance on the basis of the median performance of average students in/the particular 
class, or school. The procedure for obtaining the information to determine the desired perform- 
ance are 'des cribed in the following steps. 

« • JsSTEP ij Select matexKal fox^ task in which vevfovmanae mil he measured, 
. . Three criteria govern tlie selection of , performance ta^ska: 

1., The task must be one that can be counted. 

2. The task must be defined in specific enough terms to permit two indepen- 
dent observers to make counts and subsequently to demonstrate agreement 
* • 3* The" task must be one in which you would like the target student to 

I . perform at an average rate when the program modification is completed. 

For example, in reading, you might wish to look at performance in reading 
Che newspaper, since reading the newspaper represents a desired outcome of 
learning haw to read. The performance task would be stated as follows: 
H of wovdtS' read orall^/min. in newspaper. In math, you might wi'sh tc assess 
performance in the computation of .all , types of computation problems, rather 
than in oneopartlcular type,^ because such performance is more likely to be 
the outcome behavior, desired. The performance. task would be stated ^as if of 
math problems computed/mn. In sum, in selecting a task, the focus should/; be 
^centered on changing the student's specific performance, rather*thau on 
placement of the student in a particular category of an ordered sequence. 
It follows, then, that evaluation of success in program modification is 
based on the extent to wliich the student.'s perfornjance on the targbc^ task 
is changing (increasing or -decreasiiig) rather* than on^his md^stery of ja 
certain level of material jn a sequence. ' ^ 

Select "average" students. . . . . . ^ 

Ask the teacher (s) in the target student's class or grade to identify 
students who are performing- at an average rate in the\task or behavior 'of . 
interest. From these students, randomly select a group, prefi^rably, at 
least 8-10. * * ' ^ 

Sample peiformanoe. 



TSTEP 2 I 



{step 3] 



Take a timed sample of tJie students* performances on the behavior of 
interest. ^ 
I STEP \\ I Surmarize data. 

^ a. For each student, count the number of correct. and incorrect responses 

and divide by the length of tbe timed period to get the per minute rate. (A 
one-minute' sample, of course, does not have to be divided.) 

* b. Order the individual rates from high to Ipw and select the median 
number.. This number is the median performance rate for all the sampled, 
students and represents desired perfortnance for the task in that classroom 

■ • . ■ 1U6 . ■ ' ' . 
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ISTEP 51 



ISTEP 6 I 



Iapplicatjeon] 



ISTEP II 



I STEP 2 1 



IsTEP y\ 

j STEP ^1 



^ * ^ 

or school. • - * » 

Select and label the graph: s ^ 

at On the /equal-ratio, graph,- "fche vertical axis .should be labeled * 
"performancey/nvin." On equal-interval graph paper, the vertical ^^:is should 

be labaled/for example, "number correct/rain. "percent correct-^" "i\umber 

* / ' f 

completed/'* or, the like, depending on the perfornurtice of interest. Oh both 

gr£iphs,ythc dates on which measurements will be taken are placed on the hori- 

zontayaxis. - « ./ 

dfot/ desived pei^fomance line on the* gvaph^ 




Inasmuch as desired petformafice remains constan^^^'it .can be repres^nte'd 
as a horizontal line across ,the graph; to make it distinctive, however, the 
line should'be wavy*v>vv>A^N^ ^ . \ 

Three examples (D, E, and F) follow of the application of these procedures 
to determine- the median performance levels of Ricky^*s peers in computing 
math facts, spelling, and handwriting! ' ^ , ' 



EXAMPLE D: Determining' Average^ Performance of Ricky's *^Peers in 
Computing Math Facts - | 



ith sequence for grades 1 and, 2, the SERT determined 



Select matorial. 
In reviewing the 

that by the beginning of grade 3, mastery of add,ifcion and\subtraction n\ath 
facts vas essential. No information was available, however, on the rate of 
performance for average students. To determine the^ i^verage rate 9f perform- 
ance, the SERT prepared three sets of randomly selected addition and subtrac- 
tion facts from the entire domain of addition sums- for 0 through 19 and sub- 
traction sums for 0-9. A sample of a set is shown in Fig'* V-7. 

Selecting students.; ^ 

Upon the request of the SERT, each third-grade teacher named the group of 
students in his/her classroom who were assessed as performing at an "average" 
level in the computation of math facts, 
every fifth 'student until a group of 10 was formed. 
Saxnpling performance. 

One of the three se.le*ctions of math facts was distributed to each student, 

I 

and the group was given three minutes in which to write answers. 
Summarizing the data. ^ • j 

a. After collecting the papers,* the facts summed cor'^ ctly on each sheet 
were added up and divided by 3 minutes to obtain the per minute rate for 
each student* / * ^ 

b. These pet* minute rates were then listed from high to low. Ihey were 

/ . * ' 1 

-•as follows: lO, 14, 18., l9; 19, 21, 22, 23, 24, and 25. Because there arJt 

10 scgres, the' median falls between the fifth and sixth scores, that is. 



From this list, 
3 



the SERT sclectqd 



The procedure depends upon the total number of classrooms and students hvailable for sampling. 
For example, if there were only^one third-grade ^classroom, the SERT might select every other 
student, every third 'student,', or every fourth student -^rom among those listed as average. 

' /• . '107 : 



NAME 



ADDITION AND SjJBTRACTJON FACTS 

■ DATE PROBLEMS PER MINUTE 
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Fig. ^"7' Sample, test of the computation of addition and subtraction facts, third- 
grade students; River Run School. 



between 19 and 21. Thus^ the median is 20. 
I STEP 5 t SelecHrtg and labeling the graph* 

The SERT selected equal-interval graph paper and labeled the vertical 
\ * axis. If of addition and subtvaotion faats/min. Dates were written along 

the horizontal axis to correspond with the beginning of the school year. 
J STEP 6j Bvahring th^ desired performance^ line, - . . ^ 

% * A wavy line .wAAAVv' was drawn across the gr^fph at the l^ine representing 



20 addition and subtraction faccs/min. (See Graph 15a.) 



EXAMPLE^^fe: Determining "Average Performance tor Ricky^s 
^ r '''T Peers in Spelling : 



STgP • Selecting matfviaU ^ ^ / 

At River Run School, as in most schools, a specific sequence of spelling 
skills has _^nol ^been identified. For the, weekly spelling tests, teachers 
prefer to select words from a wide variety of sources: students* writings', 
reading selections, social studies material, seasonal words, spelling. "defions, 
and areas of^udent interest., ' ^ 

Ricky was referred for help with spelling be<;ause he was not succdeding-jOn 

these tests and, when writing stories, Wt-j^s^otc^ spelling correctly. Tna SERT ' 

decided to determine desired, performance for spelling by dictating to the 

students paragraphs compris;ihg 75 words jjppropriate to first and second * 
• ; ^ o 

graders from *'Dolch List 0^220 Most^dommonly Us^d Words"(Dolch, Note 2). 
Three. such paragraphs were ^jrepared by the SERT. (See Fig. V-8 for a sample 
"< -" l of tlie words.) ^ ' ^' ' <f 
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Fig. V-8. A .sample Hst of spelling words appropriat/a to first and second 
graders. Source: E. W. Dolch, "Dolch JlTst of 220 Most Commonly 
Used Words." Champaign, 111.: Garrard (no date). 
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I STEP 2 I * Selecting Students » * ^ . o 

' • * Fifteen. third-grade students were randomly selected from a total of 

I «* - . . 

75 third grader? at River, Run School who x^ere identified as performing 

. ^ ' ' / 

at an average level in spelling. The selected students were randomly dis- 
tributed among three groups, of five each. • 
[* STEP 3 I Scmipling perfomanae» ? , i 

* One <pf the three paragraphs was dictated to each group at a normal 
speaking rate for a period of one minute., ^ Students were instructed to, 
write down as many words as jthey could in. that time. In other uqrds, 
instead of pacing the delivery of the words to some level wh?^ch was cojn- 
^ fortable for all students, the intention was- to allow students to write 
0 as many word^ as possible. This technique provides a truer picture of the 

number of letters in sequence which students can spell correctly than can be 
obtained with the more tradi^tional approach. 
[step 4 I SvmruxHzing the data. ^ ^ ' /. ^ 

,1 a. The number of lettets in sequence spelled correctly ^was totaled fo.r 

each student.. When thi<? method is used, although the word in its entirety 
may be spelled incorrectly, the stucient is given credit for any letters, 
beginning with the firs^, whichjt^^re in the correct sequence. For 
example • if the word "f-u-n-n-y" is spelled "f-u-n-y," the student 
"is Credited with having spelled four let|:ers corractly and one letter 
^ incorrectly (an omission). If , ne word bad been spelled "f-o-ij-n-y," 
the student would also be .given credit for having spelled four letters 
rectly and one letter incorrectly (an error). ^Counting lett;ers qo-rrect, 
instead of words, helps to reduce Che error inhetent in counting all words 
as being of equal length; some words take a considerably longer time *to 
write than others. , . _ *. . 

. b. The individual per minute rates of letters spelled correctly in 
0 sequence were ordere^l from high to low and the me^dian rate determi.ned as 

30/min. correct ^nd 5/min. incorrect. 
I STEP 5 I Selecting and Idbeli' y 1fhe graph. 

The SERT selected an equal-interval graph and labe. jd the vertical 
, axis, ff of letter's ^sp^lled^ coTTcctly in sequenc^min. ' 
J I STEP 6 I Drawing the desired performance line. 

Desired performance line was drawn as a wavy line across Che graph to 
* ^ .represent 30 letters spelled in sequence/min. (See Oraph l6a.) 



EXAMPLE F: Determining Average Performance of Ricjcy's 
Peers in Handwriting 



[STEP l| 



Selecting material. ^ ' ' 

.The decision on which material to use to assess handwriting depends upon 

e 

th& particular requirements of the school in which the student is enrolled^ 
as well as the student's, age and developmental stage. Some possible choices 
are as follows; 



4 



See Starlin (1972) for the rationale for and a more detailed description of the procedure. 

, - . . 11.0 
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|STEP 2 I 



t STEP 3 i 



.Manuscript Writing (usually, glades 1-3). or ' Cursive Writing (usually, 
grades 4 and above) of any of the following: * - \ • 

. 1. Copying letters, of the alpliabet or numerals in serial order. 
2» ^Copying l^^ers of the alphabet or numerals in random order. 
..3. Writing letters. of the alphabet or numerals in serial order from 
'^dictation, i.e., without a visual match* 
4» Writing letters of the alphabet; or numerals in random order from 

■■ dictation*, i.e., without a visual match. 
5* Copying word$^^ sentences, or paragraphs. 
The SERT^^^cted to determine des^ired performance for copying a 100-150 
v;drd paragraph in manuscript writing (Fig, V-9) from the blackboard, as 'the 
task most closely resembled the classroom requirements for Ricky and the other 
, students in his class. 
Selecting students* 
Ten students were 
'* randomly selected 
from among thq 50 
third graders who 
were identified as 
average writers at 
River Run School. ' 
Sampling performance. 
Each 3tudent was 
^ given one minute to 
copy one of the three 
paragraphs which had 
beep], written on the 
blackboard in manu- 
'script writing. 



Fig. V-9. Sample para-, 
graph for average stu- 
dents to copy from black- 
board to determine aver- 
age no. of words/min. 
Numbers in parentheses 
are the word cQunt; . 
numbers unjder words ajre 
the letter count. 



if 



From: • ' *. • . » 

Level H Read Series (American Book Co.) 

Indian Messages 



ThS India'ns senr'sighais wrtlT^inoke . 
3 ' 10 1^ : 21 ; 25 - 30 
First they made a' /small fire and threw 

35 39 ^3 53 56 61 ^ 

some grass over it. The grass made the 
65 70 7h 76 .^ 79 8^ 88 91 
fire smoke..' When the" fire was smoking, 
95 100 AOk 107 • 111 ^11^ 121 
the Indian held his blanket, over the 
12^1 ■ 130 ,13^ 137 . ^ 1^^ 151 
sjnoke. By moving the blank-et up and 
' 156 158 ^ • 16^ 167 17^176 179 

down, the Indian could make the smoke 
183 186 . 192 198 202 205 210 
go up in Iqng &r shor\ pfuffs. 
212 21^ 216 . 220 222 227 232 
' All the people of the tribe knew 
235. 238- 2^^' 2^6 2^9 25'*^^ 258 
the meaning of the different puffs of 
26.1 268 270 273 282 287 289 

smolce 



Some of^hei signals were 
29^ " 298 300 303 3)0 31^ 
danger or warnin,? signals. Ciphers 

. 320 322 • 329 336' " 3^2 . 

called .a council meeting./. Still 

J^8^3^9 ' 356 363 ' 368 ^ ' 

otheri, called the tribes together for 
37^ 380.383 389 " ^ 397-^00- 
war* Others told of peade. This was, 
/*03 . ^09 ^13 415 420 424 427"" 

the Indians way of communicating 



430 „437 440 442 
with^lfre another • 
459^462 469 



455 



(6) 
(14) 
.(22) 

: (29) 

(36)" 
(43) 
(50) 
(57) 
(64) 
(71) 

(82) 
. (87) 

(93) 
(100) 
(105) 
(108) 



^The appropriateness of such a task is nn^t dealt with at nhis point but is reserved instead for 
■>the program-planping pb^e. 
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' J 

SwmaHze^he data.' 



|STEP C\ 

^ The number og letters written correorly by each student were counted. 
A letter was judged to be correct if the word in which it was written was 
legible t^s^the reader Third-grade tLchers participated in the scoring of 
the paragraphs, and each paragraph was scored independently by at least^^ewo.^ 
persons, ^n case of disagreements the lower number was selected. 

b. The per/minute rat.es for each Jstudent were listed troi^Mgh" to low 
' .and the median was selectjed: 40 letters written/minute. 

I STEP 5 I Set eat and label the graph. ' j 

The SERT selected an equal-interval graph and iabeled the vertical axis 
letters written/win. 
DraW' the desired' performance line. 





A wavy line wa& drawn across the graph at the line/representing 40 letters 
written/min. on the vertical axis. j(See Graph 17a.; 

After desired perform- 
ance has been determined by 
sampling the performances of 

average studenta vjith appro- | y 

priate'materials, the target student's perforfnance 'on the same , task is^ assessed, using>;the same 
materials; Here are' the procedures ^tcT^ollow. \ 
f STEP 1 1 . Sileqtjna^riZLir^ ' " - ■ ^ ^ 

, Use the material that is prepared to assess. the performances of average 

^ ^ students. It comprises' tasks that represent terminal behaviors of Interest 
to the people concerned with the referral. 

Although, in this manual, we have stressed primarily academic and social ^ 
behaviors as examples- of performance tasks, it should be emphasized at this 
'point-that any performance task is "fair game" for. dlscreparrcy measurement- 
as long as it is, clearly defined and can be observed and* measured. If .a 
student has been referred because there is concern that he cannot read *the 
want ads from the newspaper to find a job, then decoding want ads from the 
newspaper is' the perf&rmance of interest. If interest is in car repair, then 
the length of time it takes » an average student mechanic to repair something 
.A ^" ^ performance of interest to which the target student's per- 

formance will be compared. 
I STEP 2 I Sample perfomanQO. 

Ask the student, to perform the behavior of interest and record the fre- 
quency and accuracy of his responses. Obtain at least three different samples 
of performance from three different selections of material. 
Summarize data. ' ' * ' j, 

a. Count the number of correct and incorrect responses. 

b. Order the scores from high to low and select the median. 
Plot perfomano'e djxta on the gvaph. ' 

a. Plot the referred student's actual performance at the intersection 
of the lines that correspond to the calendar date (along^he bottom) and the 

■ ' 112 . • 
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STODENT:t;^CV<y 
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CURRICULUMrMATH COMPUTAT/Oia 



key: 

• co/?eECT , 

A INCORRECT / 

9 MEDfAN;COR«CT 
Z\ median: INCORRECT 

^ DESIRED PERFORMANCE 
.(AYERAOe STUDENTS) 



MWF 'mwf mwf *mwf'-mw? MWF 



MWF *^MWF MWF MWF MWF MWF 



MWF MWF . MWF 

56, 70 ^84 98 112 



*" Successiy^ Calendar Days 
Graph ISa^^v Daily graph showing Ricky's performance *in math computations and desired performance 
STUDENT: R^f^V' * . SCHOOL: RlC^R RUN c CURRICULUM: S^PE^-H^^ 
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Key: 

• CORRECT 

i INCOi?j?£CT ^ 
9 MEDIAN CORRECT . 
^ MEDIAI^ INCORRECT • . 

^:=ltnT|LlH^^ DESIRED PERFORMANCE 

}i.'.%-.^:U-jl^ul^'S. ;:tl,.,!;i.;,CAV£RAfrE STUDENTS) 



2S 



Ul 
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Successive Calendar Days 



^MWF Wwr Uwf *MWF-^MWF Vwf 'mwf *MWF ^MWF *MWF 'mwf ^MWF 'mwf 'mWF 'mWF MW.F'm. 

0. 7 1 14 28 ' 4? " 56 ' 70 84 98 ' 112 



Graph I6a. Daily graph showing Ricky's performance in spelling le'tters in sequence in words and 
desired performance. 
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STUDENT: Ri'cky 



lipENT: fi 

men ' 




SCHOOL: KtVer Ruirt 



CURRTCULUH: Hdnciwri+i 



•^3 





KEY: 

• COi?R£CT 

9 HEDfAN coRfiecr ' 

A MEDIAN INCORRECT 
D£SlS<Et> PEfiFOKtlAMl 
(AVERAGE STUO£A/TS)| 



•^*MWF* MWF MWF 'wWf M W^-Im WlP " A Wf M W f MWf M Wf MWf M-WF MWf 

0,7 14 28 a 42 56 70 84 

; « ' SuccqssiN(e Calendar Days ' 

Graph 17aV Daily graph showi ngr^Ricky ' s performance in writing and desireli perfarmanc<i . 



MWF MWf MWf mWI^ 

.5^8 112 



.leveX of performance (up the left side)-. 

* 'b.\ .Plot both*' correct and inG^jrrect performance the samfe way^ using 



/ : 



diffeTQnt symbols (e.g.., Q « correctrA=» incorrect) j. 

^ c. PlAce the median correct score in a ^ above the data and the median 

incorrect scor« in a A ab|ove the data^. , v ' 

lAPPLICATION I ^ There follow three examples (Dl,, Kl, Fl) . of performance measurement in 

which khe SERT applied the abo^e procedures to assess kicky '-s performance in 

"con^Puting math faces, spel^ng, and handwriting. These behaviors were 
> , ' . ^-^^ t . ' 

, ^;^ideritified during referr;al interviews as priority concerns. 

f . \ 



EXAMPLE pr: Determining Ricky's Performance in 
• . ' Computing Math Facts ^ 
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STEI^ ri Selecting the material. ^ . " ' 

^ .The SERT had prepared three sets of randomly se^lected addition and 
subtraction facts to use %v\ assessing the performance of "average" stu- 
dents OFig. 'V-7).' . , ^ ' . 
^ Sampling performance . ' . , * 

Using the three sets of. problems, the SERT sampled Ricky's performance, 
timing him for three minutes on each set. 
Sicmarizing the data. ,' . ' 

a. The SERT counted the number of corriict and incorrect facts oi|> each 
set an J divided the totals, by 3 minutes to' obtailT^t-h^ per minute rate. 

• 114 , ■ : 



/ 



I ^ b. The scores/min. were ordered from high to low and the medians were 

/ y^^selected^as follows:; , 

r^- I ^ 'correct ; 4, 9, 10, 10, 11, 12 ^ Median ; (iF) ' ' 

, ^ / . Incorrect ; 1, 2, 1,/ 2, 2, 1 Median : /C\ • * 

1 ^STEP 4 i Plotting the data for' the target student on the pevfovmanoe graph. ^ . 

Using a O for correct and*a A for incorrect scores, the SERT plotted 
Ricky's data on the performance graph. The medians of ^he correct and incorrect 
* " ' . scores were placed above the data (see Graph 15a). j 

I EXAMPLE El; Determining Ricky's 'l^erformanc^ in 
- Spelling 



ISTEP 1 I , Selecting the material'. 

The same material which was used to assess performance in-Spelling by 
Ricky's peers was used to assess liis performan'ce levels. This material 
consisted of paragraphs containing Examples of Dolch word/ from Levels 1 
and 2 (Fig. V-8) which were dictated to the students at a normal speaking 

J STEP 2 I ' Sc^pling performance. , . , /^ ^ ^^ 

The SERT dictated the three paragraphs to Ricky ^t a normal: speaking 

rate for periods of one minute. ^ i ^ . * , 

'Summarising tite ddta. - / ^ \ ' 'I 

V * ' / ' < . / 

a. The numbicrr of letters spelled .correctly and/ incorrectly in sequence//^ 

,^ . minut.e were totaled. " ^ / - - 3. ^ ' 

. ^ b. The correct and incorrect scores for the three patagraphs^cro 

ordered from high to lowland the medians were seijected^as follow^: 

Correct; 14, 15, 15 ^ Mediani 

Incorrect; 4, -5, 6 ' Medt'ari: /5\ , 

[step 4 { Plotting data for target student on the perfomimae graph. 

The SERT plotted the three .correct scores, using the O, and the thr^e 

incorrect scores, using the A , on the performance graph\ The. mcdi/in!^ 




^ ^ were placed above the plotted data (Graph I6a)/; ; / 



EXAMPLE Fl; Determining Ricky's Performance in 
Handwriting / 



I STEP 1 I Selecting the material. 



I 



The same material which was us^d to detejfminc desired performanca for^ 
average students was used by the SERT" to ^is^sess' Ricky's performance^ in 
handwriting. The number of samples was increased to seven^ however , tt> 
provide a better data base. / * 

t STEP 2 I Sampling performance. . .< / • x . - ^ 

/ . . The SERT asked Ricky to copy the sample paragraphs from the board for 

a period'^of one minute eacK. * . ' 
^STEP 3 I SwmaH'zing the data. \ • ,/ 

a. The number of letters written correctly/mlnutoT^ using the criterion 
of legibility, was summed fpr each paragraph. ^ Two {Paragraphs were scored . 
' by the classroom teachqr as well as the SERT to establish scoring rellabiUty 



im. 



/ 



(95% in each instance). 

b. The summed scopes were ordered from h^gh to low and the median* 
was selected as foXiows: 

Correct: 34, 35,*. 35, 36^ 136, 37, Aa Median: 

Incorrect: « Not counted 




What is the median number of letters written correctly/minute hy Rickv? 
Check your answer bellow., rt » ^ / 
i STEP 4 1 Plotting the target student ',3 dapa on the perfoivtance'grapJtT ~ 

See. Graph 17a. Are the seyen data points plotted correctly? Is the median 
* shown ^correctly? 
Although discrepancy data can be 
used whenever a developmental, sequence 
can be identified, , many performance dis- 
crepancies are not easily placed in a sequential co^rtcext, particularly those special behaviors thatj 
may mark a child tn the classroom as "different.*^ /A child .is more likely -to be identified as 
socially discrepant if he displa ^ys so.c ial behavibrs th^.t are considered undesira^blq (particularly^ 
"noise," "out o? place," and ."aggression") at frequencies that are greater than those desired by , 
the classroom ,socicty. If possible, .however,, identification. should be delayed until a mare oh Jeep 
tive picture of^ the child's behayior in rel<1tioa to that of his peer^ has beeo. o.bcained. . , 
Three steps are critical to the successful . implementation of DBPM for social bch»avlor^: ^ 
i STEP 1 i j Selecting ilw beha\Hor(s} toiobn^rvg. ' . j 
The behavior (s) to he observeci must be stated in specif te, ,oblocf/vc* 



/ and 



measurable teriiis 



I STEP 2 I Determine the retidbiHty tjj^ obseiv^aH^nai 



f 



Simultaneous o b6(gi;vartions should be made by two people to dete naine ^ 



/ ^ observer I reliability.^ ^ ' < 
I STEP >3 \ ^.^ ' Col teal the data over time! j 

Observations on the behavior(s) of concern must be made over a period 
'x)f days (usually, 5-7)%j:o es^tablish baseline performances for the referred 



student and his peers for comparison purposes 



i 



Select the Behaviors to be Observed 



I STEP II 



* Wliat behaviors should te observed and .recorded? Although in some appruAcheiJ 
it is. suggestpd that a decision on target behaviora depends on the indlvlducifl , 
case, we believe that a set of behaviors can be identified that fairly 
represent the "categories of concern" for most classroom teachers. These 
categories are. "noise," , "out of place," "physical contact," and "off cask." , 
The pategories and thei^ .def^in'icions folUw:'' ^ ^ 1 ' 

/ * . * * ' 

\Dqfinitions of ' Categories. / 



I A Noise : Any sound^ created by the\child which distract either 
another student j' or the teacher.f rom "the business at hand* 
The noise may be ^genera ted vocally (including ''talk outs"* or 
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The median is 36. 
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unlntel 1 igible sounds) or nonvocally (**tapping a pencil" or 
^ ' "snapping fingers") < 

2. Out of place ; Any movement beyond the either explicitly or 

.imfllicitly defined boundaries in which the child is allowed ' 
movement. If .the child is seated at his desk, then movement of 
any sort out of the seat is "put of place." 
V 3. Physical contact or destruction ; Any contact with another 

^ , pe,iis^n_pj^nothej L person ' ^ proper ty wh i ch is unacceptab 1 e to^ 

^ that person. Kicking, hitting, pushing, tearing*, breaking, 

taking, are categorized as physical contact or destruction. 

4. Off task :* Any movement off of a prescribed activity which 
does not fall into one of the thx*ee previously defined cat- 
egories. "Looking around," "staring into space," "^ioodling," 
or any observable movement off of the task> at hand is. included. 

5. Other ; Althoiigh the behaviors def^n^d above serve as a reason- ^ 
able basis for. most observations, individual cases may arise 

< in which other belxaviors should.be recorded. ^Children may be 

identified who do not 'commun icate or^who donot interact. In 
such instances, ei ther "sel f-ini t iated utterances" or ""^elf- 
ini tiated. contacts" may be added, dejined, and -recorded. 
Generally, howe/er., the First four categori es wi 1 1 encompass 
many of the discrete categories which might be considered, and 
th^ "other" category should only be used if absolutely necessary 
' I ' to clarify the "problem" identified by- the .teacher. 

Determine Reliability of Obs ervations . - . 

^ z I 



l^SifcP 1^ Tire definitions glveit vili noL in ^themselves, produce consistency /imong 
recorders, and consistency among recordefs is the criterion that determines' 
the usefulness, of a recording system. For that reason, i,t is recommqnded- 
I that whenever obsetvations are considered necessary, two or more people 

should observe and record the same behaviors at the same t'imo on at Jeast 
one occasion. Vhe consistency of these observations can then be deter- 
mined. Whenever two observers recording ,the same behavior at the same 
. ' ' * 

time disagree on the number. of times the behavior occurred, some estimate 
of the disagreement should be obtained. * ^ - . . 

1. Two or i\ore peSple should observe and record the sanie behaviors 
at the same time (at least once) to establish the reliability of dfe 
observation procedures. Be as unobtrusive as possible when making 

^ observations. 

2. • Check reliability: . • 

Divide the mailer number of ooourrenoeo 
recorded by erne observer-hti < — - ^ _ ^ 

The laT^ger nmber of occurrences recorded ~ / 

: " by the other Qboerver for the same hehavior * i 

^ * I 

3. This percentage represents the degree of reliability between the ^ 

two observations. Wlien this percentage falls below 80%, the data are not ^ 
reliable and another check should be made. * / 
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Collect: Data over Time * 

^ 1 STEP* n a. Schedule convenient periods of 10-30 minutes each day for 5-7 days 

to observe the target pupil and his peers. If possible, observe the children 
for a total of 30 consecutive minutes for five Jays; if. not, make observations 
« for at least 10-20 minutes per day for 7 days. 

b. Make up forms on which to record the observation data. The forms 
should include spaces to record the incidence of specific behaviors per 

.minute for target pupil and peers, and beginning and ending times of obser- 
vation^ (see Fig. V-10). , ' ' 

c. Obtain a stop watch ro measure accurately the time intervals (minutes) 
■ of observation. 



Recorder 
Date 



BEHAVIOR OSSI-RVATION RECORD 
— C-hi Id ' 



C i rcumstance (AcfivHy ofescrygjj 

Lengt/i of t ime- Observed . 



TARGET CHMD / 



TOTAL 



No i se ' ^ 



Out of • V 
p 1 ace 





t 1; 1 1 


/ ' 

t ^ 










1 -1 1 1 1 1 1 


L LI II 











1 1 1 I I 


1 1 1 1 II 


■M ■ 


1 





I I I I I I I I li I I 



PEERS^ 



«oi.. ffl ia a) <ii> /a asi 6i\ t» tPit rtoS /«> 



I III 



Out of 

place CtXtttC. 



y <tft fus>i an U /at nti^ 

gill ,1" in "V^'i 



LJ 



UXJ I I I I 11 I 'I /I I 



] 



Off task{j|7 AtC^ i t I I I I 

I I I I I ' I I I I Ml /I I □ 



•Physical . 
contact Vl | gtC* 



Other Q' 



contacpt Vi# tiTC * ' \ j , ' 

I 'ijl' ■ ' ' ' I I t '1/ I 1^ I I 



I II III I I I -I- I I 1/ I "F^ 



\ I 



.Fig. V-10. A form for recording obseryat ions .of; behav'or in ,cla^sroom. Each square represents 
■ one minute of observation.' ■ 
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d. Determine the random sampling methods you will use to select the 
peer group (e.g., going up and down rows; mov-i^ng from one table to another 
clockwise; or alternating from left to right)* Do not. choose peers iiho sit 
near target child and do not altei; the sampling pattern to include a beer 
who is exhibiting a behavior of interest. ^ \ 

e. la the classroom, be as unobtrusive as possible when entering,, making 
observations,^ and leaving. However, do not deliberately ignore children 

^ ^^^^ ^° ^ brief visits- before beginning the observations, 

will help to acclimate the children to your presence in the clas^roonT. 

f. On the behavior ^observation record, enter a talljr mark in the appro-\ 

^ priate box for each occurrence of a behavior during a timed minute for ^ 

the observed child. If the behavior is sustained for a full minute, only 
one mark is tallied for that minute, if the behavior does not occur, enter 

a (0). 

g. Alt^ernateiobservations between the target pupil and the, peer group, 
focusing oh a different peer each time (e.g., during 1st minute, observe 
target child; during 2nd minute, observe peer 1; during 3rd minute, observe 
target child; dfiring 4th minute, observe peer 2,^ etc.). 

jTEP 2 I a. At the end of each observation period, the number of times each 

behavior occurred for the target student is summed and divided by the l,ength 
of the observation period. This is the target student's per minute p^te of 
performance for these behaviors. H<».re is the -formula: 

Total no* of behaviors ; ' _ p x / * ^ 

, ^ length ^pf time of obsevoation (in minutes) t^%Tplpa 

* ^\ ^ 
, '__b'„ At the^s"^ obs^^ervatlon period, the number of times each 

behavior occurred f 6r alt the observed^ peers is also summed and divided by 

the observation time to obtain the per minute peer rate of performance for' 

these behaviors (as though all the behavior was emitted by one person.) 

Here is the formula: 

Total no. of behaviors - p + 

Length of time of observation (in yninvtes)-^ mte/rmn. jor 

veers. 

X \. ? 

c. At the end of all the observation periods, the per minute rates 

J, for each behavior f^r each day of observation for the target student are 

ordered from high to low and the medians are selected, ^ 

d. The same procedure is followed to find the median for the peers' 
behaviors. ' 

I STEP 3 1 Plot the performance data on the graph for the target student aitd his 
peers. 

a. ' Either equal-interval or equal-ratio graph paper is appropriate. 

b. Make up a separate graph for each behavior. 

c. The vertical axis represents performance per minute (total number 

of behaviors per minute). The horizontal axis represents successive calendar 
^-J days and should be appropriately labeled. 
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Each day's per minute rate is plotted on the appropriate graph with a 
O for the target student and a A for the peers. 

6. The medians for the observations are written in a ^ for the target 
student and a (6 for the peers. , ^ 

/ f. On equal-ra^io graph paper, the ''record floor" (least number of 
behaviors possible/minute) is computed on the basis of l?min. and drawn 
on the graph, using dashes between .^ach Tuesday and Thursday line.* 



The "Record Floor" = 1 ftlfe jlcast ^ of behavl'OTS-possible) 

Time of observation 



Minutes of Observation 
10 
11 

13 
\k 
15 



Record Floor 
.1 

.090 
.083 
.077 
.071 

!o66 



I APPLICATIOy] 



Ifythe) l^ast "umber of behaviors is "0" if is Marked juSt below t;he record 
fl6or7 

iThere follows an example of the application of these procedures the 
Lrvatio\ of Ricky and his peers in four 'categories of behavfor. 

PLE Gl: Determining Target Social Biehaviors of I 
' Ricky and Peers- « | 

— 1 ^ ' ' 



I STEP I 




prompts the 
as behav^^s 



Seleoting tm behaviors to be observed. " 

During the initial referral interviews, Ricky's teacher made the following 
itements: r^e is always in the middle of a fight." "He doesn't get along 
wibiXfhe othet students." "He makes a lot of noise." These statements 

JERT to select "noise," "physical contact," and "out of place" 
:o^observe Vn the classroom. Ricky's poor academic performance 
also indicate the need to observe off- task behaviors. 
\' i STEP 2 1 Determining observer agreement. ^ - ^ 

The school psychologist' made observations with the SERT on one day; 
95%^ agreement was obtained between them. 
Sampling the performances. . 

The SERT observed Ricky and his peers on five different days, at differ — 
ent times during the da^s for 20-minute periods. 

During each 20-minute period, the S^RT spent 10 minutes observing Ricky 
and 10 minutes oWerving his peers, alternating the minute-by-minute^ obser- 
vations. 

Sivmarizing^ the data^ 

Each day's totals were summarized for each behavior for both Ricky and 
all his peers. After the totals were ordered from high to low, the medians 
were selected for each. 
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^See Pennypacl^er, Koenig, & Lindsley (1972) for discussion of concept. 
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Graph 21a/ Physical contact In clas$rooni: Behaviors/min. , Ricky and his peers* 
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0F-FJ|:ASK 



NOISE 



OUT OF PLACE 



PHYSICAL CONTACT 



Day 1 


Ricky 
3.0 


Peers 
.60 


Ricky 
3.0 


Peer^ 
.30 


Ricky 
. .30 


Peers 
M 


Ricky 
.12 


Peers 
.20 


2 


2.8 


-.50 




.20 


.50 


.13 


.13 


.13 


3 


2.8 


.30 


3.0 


.30 


.30 


.13 


.13 


.13 


k . 


■3.0 


.50 


3.0 


.20' 


.20 


.13 


.20 


.10 


5 


4.0 .60 


5.0 ■ .20 


.30 


.1' 


.13 


^3— 


HEDIAN 











I STEP 5 I SetecHng^ the gmphs and plotting perfovmance data for Riahf and peers. 

a. The SERT elected to use equal'-ratio paper to .graph the performances 

of Rl<5ky and»his peers in e^ch, social behavior. ' ' * 

b. Four graphs were developed. Each was appropriately labeled; dates were 
placsd on the horizontal^ axis. — , — 

C. Each day's rates were plot'ted on the appropriate, graph with a O f or 

Ricky and a IS for his peers. ^^\^^ 

d. The medians were placed in appropriate^ teardrops above the data points. 

^ ' e. The record floor was drawn on each graph. Since each observation had 

been 20 minutes ir., length (10 minutes observing Ricky and 10 minutes, his 

ypeers) , tlie record floor was computed as follow^ 

^ Uleast ff of behaviors possibte)[ _ j * 
10 (length of observation period) * 

The data plotted by the SERT for each behavior are shown in Graphs 18a,^ 19a, 
20a, and 21a. ' - ^ 

\ . . 
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61 Procedures to Compute Discrepancy Ratios 



there are detailed in this sec--: 
tioil the procedures for compyting 
^ three kinds bf discrepancy Tatios and 
iisihg a Discrepancy Ratio Worksheet . The discrepancy ratibs described are for (a) academic, pro- 
gress, (b) academic perfprmance, and (c) social behavior. Procedures for using the Discrepancy 
Ratio Worksheet are given in . 

Computing discrepancy -ratios for , progress . 

After actual and desired mastery levels have .been 4etermlned in a subject for a referred st¥^ 
dent*, the discrepancy ratio between the two levels is computed by the following procedures: 
I STEP 1 I Determine the amount of progress. " ' . 

The discrepancy ratio for progress in a subject is defined as the tela- 
tive difference between desired progress (1 month progress per one month 
in school) and the target student's actual progress. The amount of progress 
desired is the curriculum equivalent in months of the number of months the *»^. 
student has been in school. The actual amount of progress is the target 
student's present mastery level expressed in' terms of curriculum months.' 
Compute the discrepancy ratio: *• ^ . 

To compute the ratio, divide the larger of the progress levels hy the 
smaller. That is all there is to it! . V 



I STEi;y2 1 
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Larger progress level ^ Disorevanou ratio 
Smaller progress level i^^orepancy latto 



|^PPLICATIOn| The formula for the discrepancy ratio for progress is applied to the 

d^ta collected on desired and actual progress in the Read Series, phoni-cs, 
and math sequences for Ricky (Examples HI, H2, H3) . ^ 



EXAMPLE HI: Computing the Discrepancy Ratio for Ricky in the 

Read Series ' ^> * 



jsTEP 1 I ^ Determining amount of progress. < 

, The SERT reviewed Graph 12b and determined desired mastery level for • 
beginning third grade to be completion of Book G or 18 months of progress. 



STEP 2 



and Ricky's mastery(Jevel> to be Page 60 in Book, C or^ 4 months of progress. 

Computing the disorepanoif ratio,, , 

28 months of progress _ a * >?. 
4 months of progress- — — 7; — 7 ^- ^ 

Ricky is progressing at a rate whdch is 4.5X less than desired for average 

Students of his agq and gradfr. Stated differently, Ricky's peers are mastering 

4.^ months of work for every month of work that -Ricky masters! 



I EXA> 



EXAMPLE H2: Computing the Discrepancy Ratio* for Ricky in the 
Phonics Sequence 



STEP 11 



Determining amount of progress, ^ ^ * * . ^ ' 

The SERT reviewed Gra|)hl3b and determined beginning third-grade 

mastery level to be completion of Category 24 or 18 monchs of progress., and 

Ricky's mastery level to be Category 17 or 9 months of progress. , * 

Computing%he disorepanoy ratio, ' ^ ^ ; 

^* .'1. • ' , 

28 monthS' of progress ^ 2 OX * 
9. months of progress ' ' ^ 

Ricky is progressing at a rate which is 2. OX less than desired for average 

.students of his age and grade. Alternatively, Ricky's peers are mastering 

2.0 months of work in phonic$ for every month of work that Ricky masters. 

(EXAMPLE H3: Computing the Discrepancy Ratio^lfor Ricky in the 
i * Math Sequence" 



J STEP 1 1 Determining ambunt of progress, ^ 



Review Graph 14b and make your own determination .of desired progress for 
average third-grade students and Ricky's actual progress in math. Check - 
your answer below. 

I STEP 2 1 ' Computing the discrepancy ratio, ' - ^ ' . * 

Compute the discrep^ancy ratio by djLviding the larger amount of. progress** 

• 9 

i by the smaller, then check/ your atiswer below. 



8 



Desired mastery level = 18 months (Category 22) 
Actxial mastery level = 5 months (Category 2) 



2$ months ^ i ' j ^ j 

O &.mnths = 3.a less tHan desired 
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} Frooedures to aompute discrepanoiji^ ratios for . * 

performance graphs* . - " • 

■ ; ' • ■ • ' • 

, After actual (baseline), performance level for the target studenr- and desired performance 

level for students, (^/^ ^e same age/grade on the same tasks have beei].,determined, the discrepancy 

.ratio between the target student's actual performance and desired performance is computed * 

the following procedures:* - 

I STEP 1 f Determine desired and actual performance levels. _„ . / 

See the procedures described in STEP 1 of and review the relevant 

/ ' graphs.. ^ ' ' , 

I^TeF^ ' . Compute the discrepancy ratio. 

Divide the larger performance level by the smaller performance level. 

larg er* performance level r 
. ■ Smcdlev pevfomanae level = ^^^^^^P^»^y ^^^^o 

fA^PLICATlQN I ♦ In the following three |examples, the procedures are applieid to computing 

Ricky's discrepancy ratios for performances on math facts, spelling, and 



Hi' 



handwriting. 



EXAMPLE. I: Computing the discrepancy ratio for Ricky in 
math fatts, spgllirg, and handwriting 



Determining desired and fictual performance levels. 

After reviewing Graphs 15a, 16a, and 17a, the SERT made the following 
determinations: ^ . 

Math facts : Ricky's actual performance level in writing answers to 
multiplication facts is 10 fact>/min. The median ratc^ of performance 
for average students in Ricky's 'gracfe is 20 facts/min'."^*'*'^ ^ 
SpeUi^ng : The desired level for spelling letters correctly in sequence 
is 30 letters/min. ; Ricky's actual performance is 15 letters/min. 
jHandwritinR : Can you determine the desired and actual performance, levels 
-foii^icky's peers and Ricky in handwriting? Check your 'ansv)er below. "^^ 



I STEP 2j " Computing the discrepancy ratios. 

. The SERT computed the ratios to be as follows: 

Math facts : ff'^^^f ^' "jf P^lfo^<^nce) ^ ^.i?! 

10 (actual rate of performance ^ / 

*> / 

Ricky is writing answer^ to math facts at a rate which is 2X less than that 
' for average students of his age and grade. ^ , 

. ' Spelling : ~ 2.0X . 

Ricky is writing l&tters correctly in sequence in spelling ai: a rate which 
is 2. Ox less than average students of his. age and -grade. , i 

Handwriting ; Compute the discrepancy ratio by dividing the^^ larger perforin- 
^ ance level by the smaller performance level. Check your answer below. "^"^ 



^^fhe desired level for handwriting is AO letters/min.; Ricky's performance is 36 letters/ 
inin.* ' ' * ^ ■ ^ / » " 



"^"^Ricky is writing let ters^Qorrectly at a rate whi'ch is ^fV. - 1 . IX lessf' than the rate for 
average students of his age and grade. 



111 



Px'ooedures ta compute' discrepancy ratio for 
social behavior ^ 

i ♦ jf 

A summary of the data from Graphs 18a-2ia is given in Table 8. 
' ' "-^^ / ' tabic V-1 



Median or Middle Frequencies of Displays of 
'Pour Social Behaviors: Discrepancies Between 
Ricky and ^Ricky's Peers 







Out of 


Physicafl 


Off 




Noise 


Place 


Contact 


Task 


Ricky ^ 


3.0 


.30 


- ^13 


3.0 


Peers 


.i20 


' .13 




.50 


Discrepancy 


15. OX ■ 


2.3X 


l.OX 


6. OX 



The discrepancy ratios have been computed in exactly the same way as those for otljier per'formance 
graphs (i.e., the larger number divided b.y the smaller). - 7» , 

The summary chart shows that during* the observation periods, Ricky was 15X "noisier," 2.3X 
more "out of place,", no different in "phy^^ical contact," and 6. OX more "off task." These ratios 
were obtained for each category of behavior bimply by dividing the larger number by the smalJer 
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In DBPM, discrepancy data are central to the determinat^^n^ •of-^trhe-re-f erred- -et^tttJ^eitt-iS problen^ ^ 

jently. 



\^dj Procedures for using discrepancy ratio worksheet ^ 

ok-- 

establishment of the student *s eligibility for special education services, and, subseque 
evaluation of the effect of different program xihanges on reducing the discrepancy. To 
meet these purposes, the worksheet is organized to show all the discrepancy data in one place with,J^^^ 
clarity and ease. , ' ^ • / 

The worksheet contains spaces for recording the discrepancy ratios for 10 behaviors at the/ 
initial assessment ^and for each program change. Space is^ also provided to show the changes < 

in thlfe discrepancy ratios over initial assessme?it after every 3 program ciianges. f , 

— ■ J 

One box on the worksheet is labeled, for each behavior assessed, and the discjepancy^ratio ^^^^^^^^^^ 
determined at the initial assessment is recorded in the space provided. The procetfures*^|b.r^i>iing 
in the subsequent spaces are discussed in the relevant chapters. " . ' 

During the initial assessment phase, the data on the worksheet are used by tfie SERT to write 
the rationale for the importance of the referred student's problem(s) and to prganize the present- 
ation at the eligibility staffing. - 

I EXAMPLE i 

The discrepancy data, for all of Ricky's betiaviors assessed by the ^ERT are given on a 

Discrepancy Ratio Worksheet ,(sea,p. ri2). The data are then summarized .on Case Report 
, *' ♦ 

Summary Two* ' ' . ' 



For reasons of space in the following worksheet two ratios have been omitted: 

^ 4 ' Out of 

■ ^ Place 

Desired Level 
Ac teal Level 
Discrepancy 



..30/min. 
.13/min. 
2.3X 



Physical 
Contact 
.13/min. 
. 13/min. 
l.OX 
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12 

Percentages also can be computed from the scores; e.g., "noise": (3*0 + .20) ~ 1 
'"out of place": (.30 r .13) - 1 = 1.30 or 130%. * ' 



c 

14 



1400%; 
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DISCREPANCY RATIO WORKSHEET 



Student, 



_ School 





Init. ; 
Assess. 


Change 


Change 


Chinge 


-Change from 
tnet. Assets. 


Change 


Change 


Change 


Change from 
Init. Assess. 


Chang^ 


Change 


Change 


Change from 
tnit Assess. 


DESIRED ^ 
LEVEL 


ISfYiOS. 


















! 








ACTUAL 
LEVEL 




















1 








DISCREPANCY 




















1 











' Init. 
Assess. 


Change 


Change 


Change 


♦Change from, 
tnlt. Assess. 


Change 


Change 


Change 


Change from 
Init. Assess. 


Change 


Change 


Change 


Change trom 
tnlt. Assess. 


DESIRED 0 
LEVEL 




















1 








ACTUAL 
LEVEL 




















1 








DISCREPANCY 


J.7x 




















/ 
/ 







/CS5. 





Ihit. 
Assess. 


Change 


Change 


Change 


Change from 
Init. Assess. 


Change 


Change 


Change 


Char>ge from 
Init. Assess. 


Changf 


Change 


Change 


Change from 
inlt.iAssess. 


DESIRED 
LEVEL 




























ACTUAL 
LEVEL . • 










— IT 












/ 

i 






DISCREPANCY 










^ i 





















Init. 
Assess 


Change 


Change 


Change 


Change from 
tnit. Assess. 


Change 


Change 


Change 


Change from 
tnit. Assen. 


Chanji 


\ Change 


Change 


Change .from 
Init. Assess. 


DESIRED 0 
LEVEL 




























ACTUAL 
LEVEL 




























DISCREPANCY 


:i.6x 
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BEHAVIOR tf i ^^ 
/ln»t 



DBSIRED y 
LEVEL 



Init. 
Assess. 



Change 



Change 



Change 



Chahge frorr 
tnit. Assets. 



Change 



Change 



bhange 



Change from 
tnit. Assess. 



Chanife 



Change 



Change 



Change from » ^ 
Init. Assess. ^ 



ACTUAL 
LEVEL 



I5L 



DISCREPANCY 





init. 
Assess. 


Change 


Change 


Change 


Change from 
tnit. Assets. 


Change 


Change 


Change 


Change <from 
tnit. Assess."' ^ 


Change 


Change 


Change 


* Change from 
Init Assess. 


DESIRED / 
LEVEL 






























ACTUAL 
LEVEL 






























DISCREPANCY 






























BEHAVIOR 






fnit. 
Assess. 


Change 


Change 


Change 


Change from 
tnit. Assess. 


Change 


Change 


Change 


Change from 
Init. Assess. 


Chai 




Change 


Change 


Change from 
tnit. Assess. 


DESIRED 
LEVEL^ ^ 














T 
















ACTUAL V 
LEVEL ^ 


3-6 /min- 




























DISCREPANCY 































more 



beMavior 





'Init. 
Assess. ' 


Change 


Change 




LEVEL N 








Change^^ 


ACTUAL 
LEVEL 










DISCREPANCY 




• 







Note: Two behaviors--Physical Contact and Out of Place- 
have been omi tted. because of lack of space. 
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CASE REPORT SUMMARii' TWO'* (s^ 



Student 



Gr^de 



Age 



Teacher 



V* ^2..; lis there a discrepancy between desired and actxlavl performances? 

' : ' What are the discrepancy ratibs^for hi^ priori (^\ehaviors? 

What data are avai 1 able on past hi^tor.y of proarfess/p^formance? 

. » List the priority behaviors and discrepancies here. \\ 



BEHAVIOR 




S£OtMMC£ 








%P€UIN<r 


DISCREPANCY 


nh 




a- ox 






a. OX 
cess 










' BEHAVIOR 




our CP 




OF/?/ \ 






DISCREPANCY 


/S.OK 













Summarize appropriate data* from cumulative file here. 
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Data collected on high-priority behaviots and past history are summarized.^on this 
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Chapter VJ 



PROBLEM SELECTION; ^VALUATION 



Problem BeleaHon 



FiX)aram Fnase: 



Initial AeecQament 
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Contents 

Overview 

Matrix questions 

Implementation 



Overview ^ , / 

When data on Che magnitude of the. discrepancies .have been 
^ collected, the next step- |.i>\^o_^valuat.e their importance and 
establish the student* 4iii&ki^iiity for service. This chapter 
focuses on thequestions, 'materials, and activities that lead 
to the- evaluation of the discrepancifes in Che referred scudenr*a 

progress/performance. Two approaches to determining eligibility for service arc diticussod:^ (a) 
. decision matrix and (b) collaborative; pBPM works with both.. It is lor the reader to decide 
which is the better model for a particular school 'or diserlct. 

^ The important point is that discrepancy ratiosj are vital to the dccision-m^ilcing process 
la DBPM, whatever the approach to detertnining servlc^e eligihillty or the other data that m;ty 
be required or desired.' During this phase of problem selection, therefore, the SI^RT (a) reviews 
i the discrepancy ratio information on the worksheet, (b) reviews the prlorltlcB whUh have been 
identified, and (c)"^ evaluates the interview d^Jta. These three items of Information are u3cd by 
the SERT to write a rationale for the Importance of the problem, and this rationale becomes the 
basis for evaluating the student's eligil>llLty for^ service at t,he staffing. 



Co ^ 

.5^ 



PROCESS: Evaluation 



QUESTIONS 

3.^ Is the student 
eligible for ser>^ice? 

Have important discrep- ^ 
anctes been Identified? 

Can a rationale be estab- 
lished for the importance 
of the problem? 

Does student meet eligibil- 
i ty requi remertts?' 



MATERIALS NEEDED 



Guidelines for making 

the cjigibility decision. Qj 

Pr9cedure$ to review and 
evaluate data. C2S. 



ACTION REQUIRED 



^Review discrepancy 
data nod select di$-, 
crepancics AjjhIcK meet 
criteria. 

Write a rationale for 
the Importance of the 
D rob I em on Case Report 
Sumntary Three. 

Conveoc staffing to 
make el Sgib^l \ ty 
decision 



giDi n 



Summarize decision pn 
Case ReoSrt Summary 
Four, (j) 



I 

I 




To this point, the a3sessnientf activities 
of thfe resource teacher haVe been directed 
toward numerically descrl5ing the slza of 

the difference, if any, between the actual academic and social behaviors of the referred student 

and the behavior desired from him by the significant others of his society. ^The definition of 

"exceptionality" implied by the assessment procedures used to yield these numerical descriptions 

I ' ■ 

is a combination of two perspectives: (a)^ the ecological (Rhoades, 1967) which, in its simplest 

'X f * * ' > > " • " ' 

terms, maintains that a problem exists when the relationship between the referred student and a 

\ I . ! • . 

significant other itt disturbed; ,and (b)^the deviance, which maintains that a problem exists when- 
ever the behaviof of the referred student deviates significantly from the behavior of his peers 
. (i.e.,- from normative behavior)! - v | 

The ecological perspective is admirable because it tends to eliminate "person blame" from 
definitions of "the problem" b)j focusing instead on a disturbed relationship betweep the Individual 
and others in his culture. The ecological perspective^implies that as much at,tention must be given 

to the requirements (desires) of the culture as t^o the behavior of the referred student ^ The 

( . ' ' " - 

ecological approach says, in fpct, that it i? hot possible. to under^stand the problem by simply 

' observing (assessing) the referred student becatise the problem does not T exist within the Individual. 
In DBPM, the assumption Is that the problem for the referred ^tudent exists Jiot in Jiim but be- 
tween his behavior and that d^»sired from him by others. T'lis .issumption is consi/jtejit wiib the ceo-, 
logical perspective and it is ,£.be reason why tlie resource teacher spends much time in interviewing 

atiu fc3tiblishing the priorities of parents, tuachocs, and other persons who are cpncerned with the 

\ ' I * 

student's development. ; • 1 . 

i ' 1 ' 

The deviance perspective influences assessment during the problem selection ,ph.is^i of DBPM by 
implying that exceptionality means th^t the behavioral development of the Indivliiual Is signifi- 
cantly different from his peers. A deviance approach, then, dir%2cts (»s tu determine tlic magnitudt, 
of difference between the behavior of t/|e individual and that of his peers. SERTs folluw this 
approach when they use direct observacylun and daily me<|isitrement uf not only the rderred student's 
behavior but, also, a sampli^, of his piers* behavJLor on the same tasks. The approach is usbful 
because it provides all the people cj^ncerned with the ^.hlld's development with an empiriA.«il des- 
cription of the behavioral differences that led Co reft>rral. 

A summary of the influence of these two perspectives on DBPM has been presented cit this point 
because an understanding of the, assumption.^ upon which ^each is based is necessary for ra.iking the 
eligibility dejiaiun — the decision that the academic and social behaviors of a ehild are. In some 
sense, ^exceptional enough to warrant special. education intervention., 

Before considering the recommended procedures for making^ the eligibility decision in a DBPM, 
however, we need to point out that in some instances the procedures for determining eligibility ar^* 
not^ in the hands of the SERT. Procedures may have been established at anotjiej; level (e.g., state 
'or local education agency) that involves other professionals to the ex< lusion'^of the SERT. Our 
view is that such instances are not only_ unfortunate but a condition which the SERf should worlj. to 
change. The passage of P.L. 94-142 should help. The f. allowing outlined procedures may provide a 
model toward which the occluded resource teacher may work in such instances: 

Approach j^l; A Decision Matrix . [\ • ' * 



Making the eligibil^ity decision in a data-bal^wj- ynproach involves estab}.ishing a decision 
O framework that gives weight to both the ecologf aS orid 



llie deviance definitions of exceptionality. 
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For convenience, we can illustrate the diraensipns ot concern implied by the two perspectives, the 
"importance/value" dimension (ecological) and the *'differer a/discrepancy" dimension (deviance) 
and combine them in a matrix: * ' > I 



Off ference/Di screpancy 
^ . of Behavior 



I 



I 



«) 

3 

> o 
ay > 
u m 
c x: 

u 

o 
a 
E 



High 



Moderate 



Low 





Large 


iked I urn / 


Syiia 1 J 






















i 

i ; 





Tt) lise such a matrix for decision making requires that, prior classification criteria be estab 
^ ' r • f / ' 1 ^' 

lished by those persons who are responsible for allocating special education resources. An 

exampl-e is given below: 

Behaviors Typically Present 



1. 

2. ; 

3. : 

ki 
6;. 

7. 
8. 



Year 0-^. 
Years 1% 
Years 
Year SM^ 



Years .6i&- 
Years 9-11 
Years 12-1^ 
Years 1&-18 




The particular value ordering ii) the example indicates that an inverse relation exists be- 
tween the importance assigned to the particular behavior and the age at whjlch it is usually man- 
ifested. In practice, this value ordering would mean that in^ decisions to allocate special edu- 
cation resources, more we/ght would be given to the development of prescnool behaviors than 
school-age beiiaviors, or that more weight would be given to the development of behaviors associa- 



ted with raidd 



le chi/< 



dhood than adolescence. 



To complete the matrix presented above, levels along the difference/discrepancy dimension 
must also be quantified and weights ,*ssigned. As, has been noted earlieij, discrepancies in per- 
formance or progress can be measured an^^summar ized by using a discrepancy ratio such as IX (no 
discrepancy), 2X (desired perforn^^nce or progress twice as great as actual performance or pro- 
gr.ess), 3X (desired performance three times greater than actual), and so on. 

Given such a formulation, all that remains is to combine the importance/value weights with 
the discrepancy ratios; the combination yields ap estimate of the magnitude of the referred 
child's exceptionality or problem. ' ' . ^ * 

^At the present time it seems reasonable to include representation from parents, general 
educators, and special educators in the "responsible persons'* category. 

1.31 . ' • ' 



An illustration follows of how such a system can be. 



Behavior 
Measured 



Reading 
Hath 
Noi 5e 



STUDENTt Ricky 

Importance/ 

Va I ue ! X. 
(EstabHsKed by ^ 
priority rankings) 

15 X 
1.0 X 
5 ' X 



age;: 



JJ, 



Di/sc'repancy 
(E^tabl ished by 
i/ea$urement data) 




Weighted 
Discrepancy 



67.5 
37.0 
75.0 



179.5 



Weighted discrepancy p 1^ = ^^'^^^^ Discrepancy) ^ ^ 

^ \ 30.0 .(Total Import/ance value) 



Although only three behaviors are used in the deriision-matrix illustration, the weighted dis- 
crepancy is 6. OX or 4.0 points higher than the 6ut-of r pf 2.0. established in Paver Run School. 
In the c'^tual decision-making process, of course, all^ IC of Ricky's assessed behaviors would have 
b'een included in the matrix. 

For each behavior, the following criterii must He met: 

1. Each behavior (or set of behaviorj&) /relevant to the initial referral be measured. 

2. EacH behavior measured be assigned An importance/value weight based on some a priori 
system (i.e., priority rankings). 

3. The discrepancy between the target^ behavio/ and desired behavior computed. 
A. The importance/value weight assigned to the target behavior be combined .arithmetically 

(as in the illustration, by mulriplicatiori) with t he computed discrepancy. 

5. The discrepancy between the total obtained for the referred child and his "normal" 
peers be. computed. I 

At this time, the decision on whether the chi^Ld is exceptional enough to be eligible for 
service^ requires a poZicy decision which is based iOn the understanding of state special education 



laws and regulations and school system 'policy 



complete the decision matrix approach to deter-- 
mining eligibility for service, a sele^ttion/rejecjiion point should be determined for your program, 
and the determination should be made in advance. 

Although an inadequate amount of research h^s been conducted to establish a firm basis for a 



ny 



particular selection/rejection pointy we believe!most .special educators would agree that 
children should be eligible for Special education service when they are at least 2X discrepant 
from their peers. When discrepancies less than' 2X are obtained, more disagreement will occur 
over whether the child is exceptional enough to. warrant special education service. When dis- 
crepancies greatef than 2X are ootiined, agreement is greater that the child i^ eligible for 
service. 
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Approach ^2: The Collaborative M6del 

Many people both in and out^of education Are skeptical of th6 possibility that decisions like 
the determination of eligibility' can be made quantitatively through an approach like the decision 
matrix. Jhey believe that/^impoytant factors njay be overlooked, thereby and may escape the 
measurement net. Too, many people believe thdt the decision process is more complex, that it re- 
quires the special abilities (and feelings) wjiich caring humans can bring to bear when they discuss 
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the evidence and testimonials presented by person§ with a vested interest in a particular case. 
For chose people who are reluctant to leave decisions to a decision matrix approach, the most 
straightforward and simplest approach is the collaborative model. 

The collaborative ihodel is essentially simple. Upon the completion of initial assessment, 
those persons who should be represented in the decision process (i.e., parents, child, general 
and special educators, principal, social vorker, counselor, psychologist ^ nurse-physician) meet 
to consider the information which has been collected. Examples of such information, are presented 
in the clear example of the case report for Ricky. 

After this infotmation is Shared, either verbal concensus is obtained^on eligibility or a 
vote is?, takeri^to determine the majority opinion. (Current efforts to protect the child under due 
prefcess^^of law suggest that a .f ornjal vote be taken and recorded.) 

Improving the precision of th^ collaborative approach usually requires that a system be 



developed, for formally organizing each type of information (i.e., medical, educational, and psycho- 
logical information, and personal opinion), which includes specification of who is responsible for 
organizing^and presenting each type of information. In addition, fairly formal procedures for con- 
ducting collaborative meetings should be established .to prevent the irrelevant dibcussion of "hor- 
^oi;^ stories" about a child's behavior, which often dominates such discussions. We recommend that 
the SERT chair such meetings, be responsible for establishing a rationale for the importance of 
the problem, summarize the outcomes, and carefully rqcord and distribute the suinjnaries to all • 
concerned parties. - j ♦ - 

A combination of some form of both the decision matrix approach and the collaborative approach 
is possible, of (^ourse, and, at the present time, desirable. To use a combination of app^roaches 
increases the data base for mak'ing the decision to allocate or not the precious and limited 
resource- of special , education service to a specific child. 



(tI Procedures to determine Hligibility for 
Special Hducation Service, Using the 
CollaboratiAyo Model - 



I STEP l| Review the oolleeted data. 

Review the discrepancy 

i 

data worksheet and the 
interview and priority 
data., V 



I STEP 2 I l^^rit^,^ a rationale for the impovtanae of the problem. 

■^^ A bhort paragraph can indicate why thp student should be considered for 

, ' servi|:e. , Be as concise and specific as po3sible. 
I STEP 3 I Arrange for a staffing. , 

Convene the student support team to consider the information gathered in 
the initial assessment of the student's academic and social behaviors, 
prioiyicy rankings, and interviews. 
i STEP 4| p-pesent^the data.''' 

' Present the data collected by the SERT 'and others 
data include tlie following: 

1. Discrepancy Ratio Worksheet 

2. Priority rankings. ■ • 

3. Rationale for the importance of the problem. 

4. Evidence that the individual's rights have been protected (e.g., 
written consent pf parent for the assessment). 

133 . ' 



For. the SERT, these 
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ISTEP 5 i 



STEP 61 



Make, the eliytbili'ty decision.* 

\ «> • • 

Make ,the elUgibility decision on the basis of the teaui's evaluation of 
If , 
the importance \of tim problem, other federal^ state, or local guidelines, 

and previo'usly ^established criteria (i.e., discrepancy ratios greater than 

2. OX). 

Stmnavize vesulth 

Record and sutAnarize the decision Inade and communicate vith parents, 
(if not present) ^nd other interested persons^ and agencies. 

3 



EXAMPLE 



STEP 



TJ' Reviewing the coll^epted'-datar 

Thoilata summarized in th^ Case Report Forms (^1, Ch. IV; ^2,. Ch. V) and 
on the discrepancy ^^orkshect were* reviewed by the SERT. The discrepancy 
ratios ranged from 2. OX less to 15. OX more for all the behaviors assess*eJ 
except for handwricipg and physical contact*. / 



STEP 



Academic Behaviors 
Phonics Sequence 2.dx less 



2. OX less 



Social Behaviors 
Out of Place^'*^.3X moro 
Off Tg^k 6. OX more 



Spelling 

Math Sequence 3.7X less Noise 15. OX more 

Math Facts 2. OX less 

s 

, \ 

Reading A.5X! less % ' ^ 

A review of the interview and priority data confirmed reading and math* 
as the highest priority academic behaviors and noise as as one of the high- 
est prioritXes in the area of social behaviors. Physical contact, ^hich* 
concerned they teacher, did not emerge after observation as a discrepant be- 
havior (l.OX)A Ricky was observed to engage in the same amount of physical 
contact as hisWers. The SERT made a note to discuss with the teacher whether 
fights wejre a pAoblem in settings other than those in which the observations 
rere made. Further cbscrvntions could he arranged if they were indicated. 
^ hnting a rationale for* the importanoe of the problem. , 



we 



\or 



^On the b|isJ,s of 
of providing Ricky 
This. rationale was 
Three\^to use at the 
Before you read 



the review, the SERT wrote a rationale for the importance * 
(and hi^ teacher) with special education support service, 
written in paragraph form directly on Case Report Summary 
eligibility staffing. 

the rationale written by the SERT, why not try to write one 
yoursdlf? Right new you have as much information as the SERT except Chat your 



experiVnc^ with the 
Is tYere justif 
What \\o you see 



activities was second-hand. 

^ C " ' . 

cation for providing service to Ricky? ' • 

as the most persuasive data. to support the position that 



Ricky sholiid reco'ive sexrvice? 

If Rickx werer a student in your school,* would fie be eligible for s<Jrvice? 
What other data would you have been expected to collect in your school? 
Do you think additional data are needed before a decision on Ricky is made? 
Perhaps >^^can share the' information o^ Ricky with other resource teachers 
in yoilr-scfioolYr district and elicit their reactions to the questions. 

134 . . " 
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^ /case REPORT- SUMMARY THREE 
The rationale for the importance- of the problem is written here^ 



Student 



Grade 



Age 



Teach^tr 



3. Is the student eligible for service? > 

Have important discrepancies been Identified? 

Can a>ationale be established for the importance of the problem? 



Write 3 rationale for the Importance of the-problem here 
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Date Completed 
'By S€^T , 



\ STEP ^ I Arvangirig th^ staffing., , , , > 

The staffing to discuss. Ricky* s eligibility was arranged at the time of 
the initial referral (see Ch. IVS. 
i STEP A i Eresenting the. data. \ 

The .SERT duplicated copies of the Discrepancy Ratio Worksheet for dis- 
tribution at the staffing.. Case Repor^t Summaries 1, 2, 'and 3 were read. and 

discussed. . ' ^ 

I STEP 5l ^ !*kLking the eligibility decision . ^ . , , 

The faculty at River Run School had previously established a discrepancy 
ratio greater than 2/ok in one or more academic or social behaviors as the 

' 13b, 



criterion for eligibility for special education service. Should the service 



fac41ities.be limited, students would be rank ordered on the basis of number ^. 
of discrepancies; those with the greatest number would be giv<m priority. 
(An altern^ive choice could be made on the basis of the decision matrix.) 



i STEP 6| Sumavizing the results. 



The results o-f the staffing are suramarizec^ in Case Report Summary Four. 



Refe 



rence 



J^hoades, W.C. The disturl^ing child: A problem of ecological management. Exceptional 
Ckllcben^ 1967, 33, A49-A55. ^ ' • 



CASE REPORT SUMMARY FOUR 
The eligibility decision is summarized here."* 



Student 



3 

Grad< 



Age 



Teacher 



A 



j*""3. Is the student eligible fcr service? (coTit.) 

Does the student meet est'Ubllshed eligibility requirements? 



Summarize the results of the staffing here. 




Date Completed ParticipantsT 

By SB^T 
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PART ,J 1 1 

* 

Developing DBi'M Skills 
in Program Selection 



137 



124 



' / . ■ ... Introduction „ ^ ' . 

Part III describes in detail thfe specific procedures that are used in the program selection 
pJ\ase of DBPM. It cojisists of one chapter and comprises th^ evaluation, measurement, and communi- 
cation and collaboration procedures. Like the chapters in Part M, thapter VII starts with an 
overview and then presents the detailed set ef questions, materials, and activities that-amplify 
the matrix cell from which the questions were taken. 

-TIjis phasQ of DBPM focuses on the selection of program, plans for. the referred studerrt who has 

identified as eligible for special education service. The term "selection" is used deliber- 
ately to empha*si ze .two points: ^ 

^t,- Wore than one alternative plan to meet the needs (solve the problems) 
» "^Nof a target child, \yho has been identified through intake assessment, 
cahvand should bfe considered by all persons involved in the referral. 
\^ 2. Changesin a student's educational program should be made on , the basis 

• . ' of explicit rather than implicit decisions. 

The first point, thb^al ternat ives should be planned and considered, is based on the assump- 
tion that the chances of soh(ing a problem successfully are increased if multiple rather than: 
one possible solution are avaihible. Little needs to be said abour such an assumption save that • 
it is well supported in the psychological literature on problem solving. No problem ever has 
just a "single solution"; a number of al ternati ve solutions can be devised for almost any problem 
and'each offers some possibi 1 i ty^of success i * 

The creation of alternative 'solutions i^an important characteristic of DBPM. It emphasizes 
^ experimental approach to educational problem^ ^olvi ng. In the intended sense of the word, 
»'e;<>er*Tmentation" /equires the systematic measuremfeqt of the effects of successive different ' ' 
changes which are systemistical ly introduced into a prb<;ess. The experimental approach is especial 
ly applicable to solving human problems because the uniqihaness of each individual makes it im- 
possible to predict the speci f ic ef fe^cts of any single changbs- or set of changes/ on the individ- 
ual. If alternative changes are devised and considered prior tb\prpgram selection, then these • 
alternatives can be tested subsequently to find the program triat i5v(TTost successful. The attitude 
engendered by this apprpach prevents the professional staff from tryin^to predict the futurg^on 
hope alone. DBPM estab 1 i shes at the outset that no one knowV exaclfy^ha^v'^rograrn is best for a 
pupil until different progr^ms^ have been tried* \ ' • . - 



The second point emphasizes that once e'llgibility has been determined!, progra(ii^changes do 
not just "happen." Rather, they proceed from forjnal or informal plans which have been developed 
and acted upon by people who are in a position of influence relative to a student or^probj^em. 
Making the. process of selecting programs expl ici t has several good effects. 

^ 1. Program accountability is increased by making public who is responsible 
for the program decision, how those decisions are made., who is doing 
••what to whom, and when program changes will be initiated. 
2. Opportunities for making program decisions collaboratively rather than 
unilaterally are increased. With the growing recognition that all 
* ^. children have a place in the normal regular school envi ronrpent, mech- 

anisms must be created for developing and maintaining a sense of shared 
responsibility for the programs that are available there for the child- 
ren. Collaborative decisions in "program selection"* make public 
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the fact that a group ofjrofessionals rather th.n « 

alone has a stake in th. c ' one resource teacher 

. . -^■-■v.....„„j:::::::-::::v° :::;:;:t'r"""'^' 

.. ^'^^ P'-°9rams were designed (Hobbs- 1970 r 

our po.nt-of view, the primary cause of such rrj 1 • - 

• --"tercontrol procedures^in^ducational-n 

- . • . - P.... --■-"^^::;:r;;:::r::;;:::::::r?' 

^,encra I izat ion of power ha<; 1p;< / > 

of state hospital oatientc . • ''^^ treatment 

■ ■ • in^lueneeinsc iTs^t r'^°"'"^""- '^^^^"'^ " ' ' 

Publ.ic decisio '^'^ '^-^•oped only recently. A, 

puDl.,c decision-mak.ng process that includes fair .nH • 

of -^11 involved parties insur.. representation ' 

^ ^ K«aities insures opportuni *-ip<: fr^^- ^« ^ 

as control. ^ ' riuni.ies for countercpntrol as well 

Educational programing for exceotion;,! ^ . ' ' 

- pro..- .„e,„p^„. I L : '"""^ '---^ ^^-^ 

pro<,ri„,»Uc,i<,„ „schanis„ th« Inc udes ',h. "'"''"""'Jv to develop , 

.--.s .o . i„„wed i„ .e, deoi;:r„'::„r::::::: °' - 

.n,tr„e„, Vo.r-,„|„ees Is .He Le , " 

(page 126). 1„ contract each ™r,- ■ ■ """'"-Pac^nt-school staff ccnu^ci - 

as fei." ,rf ii: ::'""'.r":'t - - <«: 

. experience, a p„M Ic „lt„nt sl.nl ~ t". o„. 

-•M ..e«t ana the selected pro,™ „l | „ ! ^ ' ^ " ' ' > 'ty 

PI... review ..-.ced„re ,1s ,ncl„4e m t 'pi ^'l'' ' 

oo-.. .oals, .ese activities are descrlLT: e ^ T::;^ '° 
measurement, and co-mlcatlon and collaboration. foU^.ng chapters on evaluation, 

The forms and.mater ia Is for data n;,fh^.- . ' . - 

^"a o„ Mc, are presented. The c e^pVIV"?''' ^ =™"rv 

c 1- "'c.ape^iric Steps taken bv fhp <;fct : 

folr ows; , ^ K en Dy the SERT |n program selection are as 

HEII . select specific discrepancies to . edified during first ln-terven..n. 

^ 1 



Write long-range, weekly, and/or dally objectives for „.,.,■ 
specify two program changes for eaci obtClve 

so.e guest!:::':: 2:::"::z 
. -Id you have s:::c::d™ ^eT o7b:::::::s f:?'"^ - - 
not, Which .o,id you have seiec":: ::: 'zr'" 

. Education AmenH.pn^c ' "^"""^ ^° -P'-ent 



P. t-.- 93-380, Education Amendments qf I97/,. 
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AGREEMENT: CHRIS T. /SCHOOL STAFF/PARENTS 
Concerning the following behaviors: ^ ' ^ . 

1., On-task effort; Work -aVassigned tasks. . 
2. social-verbal -behaviors: On^ti^e^^^^^^^^ • " 

Refrains from disruptive interaction 

'"■'^''Tut d°own hi. noise and talking out-of-place behavior to a satisfactory ( 
le</el as determined bv classroom teachers. 

(Room 311) at the end of the day.. 

f. 

Teachers agree to: , . 

1 Fill out the daily point sheet. . 

- / 

Mr. M. agrees to: . results to teacheYs ancj/parents. 

, 1: -iror ThM^^^r-ttmrT.^^^^ ^ 

' Tr^ange^rcSris^'to-go^with his friends on a four-day camping trip - ■ 

2'. ilkelhHf horseback -riding wiih his friends (if earned). 
POINT SYSTEM' minures of free time. ' , 

• , ^ .nv of the f6l lowing or other activities agreed upon by 
Free time may include any of tne roinw. y 

Chnis and Mr. M.: ' ' , j game with a friend 

Use the race car set m Room 311 ygin'-AV machines in media center 

• Early dismissal > . „ 

Time in Ms. B.'s EF.SA Reading Room 

Hf'hris is placed on detention for i'nappropriate hall behavior he will 
2".. llr^h^: trStacI^rSe^tlo^r times-he will lose the opportunity to 
\ go on the camping trip. 



Name 



/s/ CHris T. 

/s/ Jane T, (Mother) 




•> 

/s/ Arnold T. (Father) 


Vl8/7'i 



^ Name 

lil David D. (Teacher) 
/s/ Wayne M. (SERT) 



'4/19/7'* 



'4/18/7'* 



Fig. Part Ul-l- A contract 



agreement between a student/school staff/parents. 
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in your school? If not, what are ^he forces "acting for and against thq. 
development of such arrangements i.;n your school? 

Prograrrr objectives are written in terms o^ !^ges to* be completed," 
"increases in performance/minute,'' and the Uke. What are some altern- 
ative ways of writing program objectives for the same behaylors? 
What are the major differences between DBPM and other approaches you 
may have used before in program planning? ,\ 



Reference 



, N. The futures 'Of children. San Francisco: Jossey-'Bass, 1975. \ 
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Chapter VH 



PROGRAM selection: EVALUATION, MEASUREMENT,, AND 
"COMMUNICATION AND COLLABORATION. 



Decision Area: 
Program- Seleoiion 



Pvogvm Planmng 



I 



Overview: Evaluation 



Contents 



Evaluation 
Measurement 



'Xommunication and 
Col laboration 



Kow that the. referred student has been identified as eligible 

for jspecial service, the time has come to select a program for him. 

During the first phase of program selection ti^ SERT carries out four 

activities: " 

1. Select the first set of behaviors* to be modified. \' 
.2. Generate long-and short-term objectives for eaah targeted behavior on the baa 1ft of the 

estimate of progress/performance that is needed to substantially reduce the pupil's discrepancies 

within a specified time period. « ' . * 

3. Select at least two program changes for each targeted behavior. 

4. Generate two alternative administrative arrangements for lmplen\ent ing thi? program. 



ft) 

CO 



S CO 

ft: ^5 
CO ft: 



PROCESS: Evaluation 



QUESTIONS 

5. 'What program plans are 
^p^opo?ed? 



MATERIALS NEEDED 



ACTION REQUIRED 



For wTvi^ch identified discrep- 
anc^ies w14J programs be devel- 
oped at thhs. time? 



Procedures to select discj^p- 
ancies to be nx)dified. 



icrep 

0 



Select (liscrepancics 
for which a program 
wi 1 1 be developed. 



What program objectives are 
proposed for these Eefiaviors? 
What progress/performance is 
estimated? How long an inter- 
vention/is planned? 



Procedurgs to write object- 
ives. ^ 



Compute progress/per- 
formance estimates; 
select intervention 
period; write long- 
and short-term objec- 
tives for each dls- , 
crepancy. 



What program changes are pro- 
posed? 


Guidelines for specifyino 
program changes. 


Select at least tv/O 
program changes for 
each objective., 


Complete Case Report 
Summaries Five & Six* 


What resources are available 
to implement the plan? 


Suggested alternative ad- 
ministrative arrange- 
ments. 


Propose 2 alternative 
arrangements to ^ 
implement plan. 




\ ' 


Complete* Case Report 
Summary Seven. 
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Procedures to Select Behaviors to be Modified (T) 



Writing Pro^gram Objoct-ives^ ^ 



Given the time and person 
power constraints within a 
* school, it is usually' not pos- 
sible for a. SERT and other per- / 
sonnel to develop a progra^ plan which includes all the discrepancies which have been identified 
for a student. From our experience, the behaviors that should be given the highest priori^y in the 
first phase of program mod^ficnrion are those showing the larges.t , discrepancy rat:^os and chose 
behaviors which have generated the greatest concern among the parties to the problem-- particularly, 
teacher*, student, and Iparent. " ^ . 

I EXAMPLE j 

From the Discrepancy Ratio. Worksheet, the SERT identified Ricky's greatest discrepancy ratios 
as progress in reading (4.5X) in the Read Series; progress in the math skill ^sequence J3. 7X) ; and 
noise in the classroom (15. OX). Vn consultation with Ricky, one of his parents, and othe/ staff, 
members, the- decision was made to select progress in reading, computation of math facts, and noise 
in the classroom as. the first behavir rs for program modification. The ' rationale for the selection 
ol math facts rather than progress in the skill sequence as the pinpointed behavior vns based on 
the premise that mastery of math facts is a prerequisite to mastery of other skills in the math 
sequence. (See Case Report Summary Five.) . ' ^ 

In t>BPM, progress / per forma'nce objectives are 
written for both short- range (usually daily or' 
weekly) and long-range goals. The latter specify 
the desired levels of progress/performance that, will 

entirely reduce the initia.l discrepancy. The daily and/or weekly goals aro^rltcen as subsets of 
the long-range goals.- Objectives are written in three steps: ^ 
IsTEP 11 Compute ppogvess/perfortnanee cstimateo for the kerjaviors. 
ISTEF 21 SeUH an intcr}><>ntion period for eac*h behayior bnaed on th^ estitnateo. 
^STEP 31 Wite the objectives. 
i APPLICATiON I There follows an example of the steps taken by the SERT to write program 
objectives for Ricky for progress in the Read Series, performance in com- 
puting math" facts, and performance in noise r^jduction in the classroom. 

{ EXAMPLE I 

^STEP ll Computing progveeo/performance estimates )^pee Tables Vll-J a/id VU'-2). 
The procedures for computing progress/performance estimates are outlined in Chapter 

III as follows: ' ^^.l"^ 

* ^ — ' 

/ Determine the time available for the program modification. s 
Subtract the student's present mastery or performanae lev^l from the . ' 

desired mastery or performanae level at the end of the time allowed^ 
f^^ the program modifieation to determine the amount of improvement 
needed by the student. 

Divide the improvement needed ^mastery or pprformanoe) by the ttve 

Availab le for the intervention. 

The rationale and procedures for writing performance objectives are not described here. Readers 
who are not skilled in these procedures are referred to mjterials such as those developed by Mager 
(1962) and Wheeler & Fox (1972). See also Ch. III. 
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" f KXAMPLE I . . ' X 

In Tables VII~i and VII-2 there are given the computations made by the SERT, first for pror 
gress estimates for three behaviors and, second, for performance estimates for four behaviors, ^ 
Estimates were made for two time intervals for each behavior. Estimates of perfprmance differ ^ 
from estimates of progress only in that intervention periods are usually specified in .weeks inj 
stead.Tof months. - ' ^ 

I STEP 2i Select an intervention period for each behatfior. 

Once estimates are computed for diflerent time periods the SERT uses the ej^timates to decide 
how long an intervention may be required to bring the pupil up to desired behavior. ^ 1 

The decision on the length of the intervention must be made within the contaxt of all^the 
Information collected on the problem. The following question^ should be cot\sidor(gd: ^ . 

1. How important is the behavior (i.e., has it been designated as high priority)? 

2. What is the magnitude of the discrepancy? Larger discrepancies require longer inter-* 
ventions. - * ; " ^ [- 

3. How. much daily instructional time is available to provide spryice (i.e., how often will 
the child receive instruction — min./day, days/wk*. )? If the daily time is short, a longer inter- 
vent ion period will usually be needed. 

^ A. What arrangements will (or can) be made to provide service (i. e. , Individual vs. group)? 
5. Given thie student *s history and the estimates for different intervention lengths, ^Aitch 
estimates appear more realistic, for this student? • j 

The estimate provides* another pertinent piece of data to aid in decision making. Give|i the 
information you presently have tor Ricky, which intervention periods would you select for him in 
each behavior? The following were selected by the SERT: . ^ 'I 

a* Reading Progress ; Reading is the highest priority behavior for Rick>f*s 
P'-ogram« The SERT plans to^ propose t;hat at lease one-half hour of daily 
service in -reading be provided for him. Therefore, it seems realistic to 
plan an intervention of 9 months rather than 18 months, given the estimate 
of 6.5 pages per day mastery needed to reduce the discrepancy by the end 
the 9-month period. (See Table Vll-l.j" , 

b. Computation Facts : The two estimates here are for 10-week and 20- | 
week interventions. The SERT selected the 10-week estimate of 1 fact/ ; 
min. faster/week as a realistlc^^al. ^ ; j 
(See Table VII-2.) . ' | 

c. Noise Behavior : In this instance "il: j.s mojre difficult to decide how 
much time it will take to reduce the discrepancy iix^Ricky's noise behavior. 

"^-The SERT has not worked with Ms. B. before and is uncertain of her commitment 

to the consultative arrangement she would like to recommend. The behavio^ is 

I 

of great concern to the teacher, ho -ever, and it seems important to ^pond 
time consulting frequently with a teacher to achieve success. A 9-w'2ek inferr 
vention period is selected, therefore. (Seo Table VII-2.) ! 
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I STEP 3 [ hYite the objectives. ^ 
- j 

Using the estimates selected in STEP 2, the SERT wrote long- and short- 
range objectives for Ricky's program. 

a. fhe long-range objective for Ricky in reading progress was to achieve 
the desired mastery level in 9'months. For Ricky's age and grade, Riastery 
level performance (see Chapter V) is to read 50 words/minute or better with 
2 or fewer errors and 80% comprehension. Therefore the SERT wrote the 
objective as follows: 



Long-Ranga Objective 
By the end of the year (9 months),, when given any three ^ 
sample selections in Books C-H in the Read Series, Ricky 
will read at the median rate of 50 words/min. or better with 
2 or fewer errors and 80'^ comprehension. ' 



b. The short-*range objective translates the long-range objective into 
daily, weekly, or monthly achievement/ 

For Ricky's reading progress, daily, we6kly, or monthly desired mastery 
levels are determined Uy divi(ling all the material in tlie 9-month period 
by days, weeks, or months, depending on how the short-range goal is written. 
Fr9nj Table VII-1^ we can see that Ricky must master 6.5 pages per day, 3'3 
pages/week, or 131 pages/month . The dally objective, therefore, was written 
as follows: ' S 



Dai ly Objective 
.Each day, when given successive stories from Books C- ri Tn 
the Read Series, Ricky wi n read sampi e- se I ect ions from 6.5 
pages at the iTiedian rate, of 50 v;ords/min. or better with 2 
or fewer errors and 80^ comprehension. 



The weekly objective would be written as ^follows: 



Weekly Objective 
♦ Each week, when given successive stories from Books C-H 
in the Read Series, Ricky will read sample selections from 33 
pages at the median rate of 50 v/ords/min. or better with 2 
or fewer errors and So:^ ccnprehens ion . 



The monthly objective i.ould specify mastery level performance on sample 
selections from any of 131 pages. 
Following the same three steps, the SERT wrote the long- and short-range performance objectives 
for math facts and noise. The objectives for all three behaviors were writt^-n on Case Report Num- 



mary Six in terms of conditions, behavior , and irireri,j.' 
achievement of the object ivos .were also \ ritten. 



Program changes to facilitate Ricky's 



.format is used by Wheeler & Fox -(1972). 

ERIC \ ^ 
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Table VLL-l 
Progress Estimates for Ricky 



ls5 



BEHAVIOR 



TI^^E AVAILABLE 



IMPROVEMENT REQUIRED 
IN TIME r 



IMPROVEMENT REQUIRED 
IN mERlAL 



PROGRESS ESTIMATE 



TIME 



MATERIAL 



READING/ 
READ. 

SERIES • 



ONE SCHOOL YEAR 
(9 Months) ^ ^ 



Desired 
Actual 



27|mos^. 
-4! mos.i 



Books 1/3 C,D,E,F,G,H = 
1180 Pages 



23. 
9 



mos. 



IMPROVEMENT 23 
REQUIRED 



2.5 
mos, / 
mos. 



'inos. 



TWO SCHOOL YEARS 
(18 Months)' ' 



Desired 

Actual 

IMPROVEMENT 'h, 
REQUIRED I 




iBooks 1/3 C -*I 
1710 Pages 



32^ 
18 



mos. 



1.8 
mos, / 
mos. 



Months ^ 



1180 t)p .^ 
9 mos. 



. 131 
' pp./ 
. mos. 



1410 pp ,^ 76 
18 mos."" PP^/ 
mos 



Weeks 
1180 
36 



33 

ppy 

wk 



1410 19 
72 " ppV 
wk. 



Days 

1180 ^ 6.5 
3?80 "* pp,/, 
day 



1410 _ 4 
360 " pp./ 
day 



MATH/ ■ 
SKILL ■ 
SEQUENCE 



ONE SCHOOL YEAR 
(9 Months) 



if 



mo.'; 



5 mos. 



Desired 

Actual 

Dn'ROVEMENT i22 'Jios. 
REQUIRED 



SKILLS 2-37 
35 SKILLS 



22_ 
9 



mos. 



mos. 



2.4 
mos. / 



35. 



^ mos. 



4/ 

mos. 



35 
36 



1/ 
wk. 



,35. 
180 



-2.1 
day 



TWO SCHOOL YEARS 
(18 -Months) 



Desired 
Actual 



?^6 mos. 
-5 mos. 



s::iLLS 2-57 
55 SKILLS 



31. 
18 



mos. 



mcys7 



1.7 

mos . / 
mos. 



55 
18 



3/ . 
mos. 



55 
72 



.8/ 
wk. 



55 
360 



.11 

day 



IMPROVEMENT ,' 31 mos. 
REQUIRED \ 



PHONICS/ 

SKILL 

SBQUENc"fe^ 



ONE SCHOOL YEAR 
(9 ^^onths) 



Desired 
Actual 



f 27 mos. 
' -6 mos. 



OhJ. 8-32 
24 Obj. 



21 
9 



mos. 
mos. 



IMPROVEMENT 21 mos. 
REQUI*(ED ; 



2.3 
mos. / 
nos . 



24 
9 



2..6/ 
mos. 



24 
36 



.6/ 
wk. 



24 
180 



.1/ 

day 



Tls'O SCHuOL Yt:ARS 
(18 Months) 



Dcj J red 
Actual 



36 mos. 
•6 mos. 



Obj. 8-37 
29 ObJ^ 



30 
18 



:MPROVEMErr 30 mos. 
^ REQUIRED 



mos . _ 1.6 
mos . mos . / 
mos. 



29 

it' 



1.6/ 
mos. 



21 
72 



.4/ 
wk. 



29 
^360 



.08/ 
day 



14 it: 

^ ^ .^See Section 2 Figure' 16 for Pages/Book 

fcKJL)^ ^ ^ I 



For many skills a prbgvess estimate for days yields a relatively meaningless number. 

: • I • It 



' Table VII-2 
Pcrfdrmance 'Bstimates for Ricky 



133. 



BfeHAVIOR 



PERFORMANCE 



TIME AVAILABLE 



>ERFORMANCE tbTIMATE CAPPROX-) 



COMPUTING 
MATH FACTS 



CHANGE REQUIREIJ 

Desired 20 /min 
Actual -10/mir 



Required 
Increase 



10 Weeks 



20 Weeks 




l^fact /mill, 
ncrease/wk. 



• 5 Vac ts /min. 
Increase/wkT 



SPELLING 
LETTERS 
CORRECTLY 
IN 

SEQUENCE 



Desired A5/min. 
Actual -15/min. 



f''"^"'^ 30/min. 
Increase 



5 Weeks 



15 Weeks 



30 _ 6 LetterAin Seq/min* 
5 Increase/w> 



30 _ 2 Letters in i^G^/n^in. 
15 Increase/wk. 



WRITING 
LETTERS 
(HANDWRITING) 



Desired 45 /min. 
Actual -36/min. 



Required 
Increase 



9 /min, 



9 Weeks 



18 Weeks 



2^1 Letter/min. 
9 Increase/vk. 



__9 _ .5 Letcers/min, 
18 " Increase/wk! 



NOISE 



Actual 
Desired 

Required 
Decrease 



3*0/min. 
2/min. 

2,8/min. 



IQ Weeks 



20 Weeks 



2.8 .28 Noise/min. 

lO.O = Decrease/wk. 

2.8 ^ .14 Noise/min. 

20.0 " Decrease/wk. 



\ 
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Student 



CASE REPORT SUMMARY FIVE 
Program plans are summarized here. 



Grade 



Age 



Teacher 



11. PROGRAM PLANNING 

5. What program plans are proposed? 

- For which identified di screpanc tes will program plans be developed 
at this time? 

What progress/performance is needed to reduce the discrepancies? 



List 





















s. 




6. 



Summarize estimates of progress/performance needed to reduce the discrepancies here. 



CO 

o 

> 
< 



us 





9 















































CASE REPORT SUMMARY SIX 
J Program objectives and proposed changes for each objective are summarized here. 







5 




9 






Student 

# 




Grade 




Age 




\ 1 Teacher 


5« What program plans are p 


'oposed? (cont. ), ' 





What program objectives are proposed?. 
What program changes are^ proposed? 



Long 
Range 



List long-rang^, weekly, daily objectives and progjra'm changes for each 
program modification here. 



■\ 



-2? 



Behavior 




CONDfTIONS 



BEHAVIOR 



CRITERIA 



^0 



^yHtji^ 



Behavior 



Long 
Range 

Behavior 



Change I 



Change 2 ^fMC/uy : A>iViA u)i'JJ/ie eAMe^-ferA^A J*^ ^ie/ji^ 

Change 3 ///ff^y IajW /V/i» /A/j^ ^Wc. 



CONDITIONS 



cndi of 4 /O- 



•BEHAVIOR 



CRITERIA 



f^icMif Oil// Luty'/c, 




Behavior 



Ench ooceA Q)\/ef) 



Change I Q^f -f/fi&h c.Ard. jjSrACf/'CC 



AJtist, 



Change 2 (j)f^'Hi 

Chang°6 3 Ih^M EC Cj^ Mi J »' /hlf t^JCTCAcA ^AL 

^of/}^s cot/r^^ ^«f^cL io -fA a 



CONDITIONS 



BEHAVIOR 



Long 
Range 



• Behavior 



/o-a>eeA /ff/yocL 



Dal ly 



Behavior 



Chanqe I Cfifi-^rOiL'^ 



Change 2 /Q /V)/r)L>^e^ cfA/A 
Change 3 ChcOS& A ■fir/^/)i 



Of vto -fi^ciyninttn. 
OJi'tM •i Or f Cuter 
errors. 



f'5, / -f^c^ 
firc^iotij tucefj. 



:f^ERIA 



in re/9ef/^' 



/95 peers* 



^//j y fiMj^ fjj/ M C/9rs. 

I'] .9 ; 



i 



us 



Guidelines for Specxfvins[ iTogran Oori5^e% 



If the problem you are atteapf-- 
ing to solve requires a change In 
student performance and you arc 
' looking £or some guiding principles 

to help you decide What program plans (changes) to nialj.e».kt?ep th^ falU*via|^ iLiK gulJ«fl4f^« 8iiti4> 

1. Always ivy as w first amnge talkin*7 vith the nv^Un*, t 
a., "showing him the performance that you d^^slre, and 

^ b. explaining to him who thinks the behavior Is iopnftant and wtw tU^i* '^lt«%a» iJt im h 
imporcanc. ^ , " < 

2. Avmnge ample oppovtioiitif fori studi'nt t, pr^^tt-*-^ . z*h : ^ 4 
measianng. 

In effect, this second guideline means thai yv»u ahv^uld ai» '«rf.4t*t/* ifi%?f *. r ci »r^V 

dent can spend most of the dally lesson time pra. ti^ trti^ »a the tt"-»t * % r**%: i«, if * * 

o 

attempting to improve word- recogn^lt Ion pr*j£l*.lenv * and, ^ . an 4•^taif*tr*/. a iMfH^+i* f 

words In context" (oral reading), then most t*f the dally i«?«s.j»n sh-,*^! I rr^ ^ *^ rr44i»i5 

orally the same words, essentially, uS those In tht* tvst p-a^^i^*^^* i' ^* ^ '»?^ fi.<»»i,-^^- 

for improvement In recognizing words in familiar p tXww t^^^Jy^ a * i * * *»s^#^<* « 

different from the test passages. The prln* {pie w*.»uld hinia tru*^ ^^r t 3r » / ^ % 

task In any content area. . ^ 

This second guideline Is esp'iclaUv Impurtant whia\3 pr.^/.r i*^ >^*f*?ifi 
have revealed that <:hildren who are perforrain^ pourlv n jJ* * ^ 1 U'^yi* i« ^ i \iim 
actually .working directly on the skills in whi. h they ir# XM^nt . if*- 3^*4 UU - i« t:» ^5^, r 

tant In the development of programs* tu Infjlutntt- iaj. ^tii^vi ^*, j-i t r ^ - r^«# i 

you are attempting to Increase the frequen*.> uf a ^.hlld'?* lot* r* t » .-- 4 * 
arrange for ample opportunity for him Co practice at social inter* Ti.* "^"^ 

3. j^Have the student set irrpiY^Vf'ret^i^ijoi^it in! '* *^*^yr ;r^rJ^ ' ^ . * , 
Because we are concerned wttU Improving ^tud«'n t p« ri*>r^in*» . ? t * . <r* . 

, ponslbllity for effecting a diange. When we JiHHtm^ this r#*spon%l^i i Ir . v-^ ri^Tj*^,#» «' ^U^f *ts** 
the central role he can (and should) play in vh/jnv'Jnje hl^ .*vn H^h^ivl -r H , 1 t 
both setting goals and monitoring his pro^*.re«s thrt*»i^>b ^rrpbluK * *1,t i 1 a-^if 

Improvement. (S^e^-Starlln, 1972, and Ch. II.) ' ♦ 

4. Examin^^ihe student's pei^foi'nance ji^'j^h^L^--^' ^?*4;ln* x- ^ , 

ahd^vaise ( socially vetnfov*yr} ifnpvovfriii^t. 

/ 

X An individual can Icprove his performance in l«it*laM*»A h^t . gt-n*^^ » U # , it I* »i f* * * 
l^rn with people than alone. More important, porh^jps, liw n^** i^;, />-«^*l«t«'^-; ^* * i 
y which may be the most durable set of Influences for beh.ivlor . hm^*^ \ f%^i'^*^r^^r^ w \^ . 

through guidelines 1-3 above, you will ne»-efifrarl|v \t\^ * trt. t uifh *f*,.t#«^{ # • 
reinforcement^ should occur naturally. , We need in erniih^ttil./*-* r>'# i.*p.»rf in p « ^^^yi^r 
(not just praise) tor improvement, huwi»ver, and t** h* tlt-tr that fh..«r y^w^t 
to improving performance rather than to practlcln)^ on th. t.i^k. 
' . NOTE : . ^ ^ . ' ' 

The foar guidelines rec^^mmended above (on«Jtltatf a srt .*f * h-m^r^ ii£*i*^^^ v^^l* - ^fX ' ^ 

program changes should be tested. We often have found that rf;»*«r «!'4o/.*4, ii r,* tr^ ♦ > 

. produce improvement and that they can -'const Itut** the } u^' ' [n^^r*^^*^ » r * r*^ . l^v r*- /-ww^Ml^^il - - 
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this set, w ^re challenging you to try to find additional changes that will, in fact, improve 
a studOnts "program beyond the set recommended in guidelii\es 1-A. Other changes will be found to 
be more- effective b/t this basic ^ct of guidelines is the standard. 

.5. Be Quve to avi^nge Sifftrefit junsaqumoe^, for different Mounts of improvement as one set of ^ 

program changes, • ^ \ " . ' , 

As teache^rs, we often a.ssume that performance can be improved by a new piece of curriculum 

or a *new^, teaching method. .T/e tend to view all academic problems as skill deficiencies. In so 

doing» we overlook the enormously powerful influence of motivation on improving performance. If 

^ . ' / • • . . 

desirable consequences (free time is one of the best) are made available to the student contingent 

Upon gradual improvement, reasons are created for him to manipulate his own instruction in the 

way that best suits him. You may be surprised to find that apparent skill deficiencies disappear 

rapidly if the student has good reasons to eliminate them. One surprise for us has been the 

rapid disappearance of "reversals" in words, letters, and numerals which has occurred through 

arranging contingent conseque'nces for correctness, 

6, Use cthex* students in a teaching role whenever individual J-n^truation ts necessary. 

A^signi f icant body of literature exists on the effectiveness of children as teachers. Care- 
ful recruitmer^' and training of students as tdachers enormously increases for the student who 
hiis^diff iculty ' both the available instruct iohal , resources and the opportunities for social 
^reinforcement in learning. Peer cooperations facilitated the development of acadj^»mi< skills in 
l5oth the tutor ^nd tutee; it is .also an occasion for increased personal-social development. 
. / Various arrangements -whicn can be added to the "basic set" to create program*modif ications 
are shown in Table 711-3- A detailed list of change strategies is given in Appendix C. , 

i EXAMPLE I 

The first set of changes proposed by the SERT foi Rtcky*s prog, am included the following: 

J 1. Development of a contract (Fig. VIT-l). ^ 

' ' 3 

2, Development of a Token Economy. ^ o 

3. Practice on the task. . " . 
The proposed changes are listed in Case Report Summary Six. ^ Note that these cluinges do not " 

call for the implementation of alternative curricula. Contrary to other approaches, DBPM procedures 
try to maintain cohesiveness with existing programs as the fi|r&t. steps in program modification. 
Vhe proposed changes aie systematically tested dur in^ program implementation. Adjustments are 
proposed as the data on these changes are collected and their "effectiveness in reducing tlie 
discrepancies is evaluated. ^ 



Procedures to' Determine • Al tcrn^ati vc 
Admin i strati ve Arrangements ) 



The select'i.on of a program may 
not be restricted only 

to instructional materials, procedures or 
incentives: where possible, physical or 
administrative arrangements should £llso be negotiable. In Fig. VII-2 eight styles of service are 
shown. ... , 

. The distinction is made in the illustration between direct «lnd indirect service. Direi-it 
service refers to program modifications which are planned and implemented by the SERT,. Indirect 
service refers to pro gtam modification^ which are planned and' implemented by others (usually, 
^See Homme (1970). ' ^ 

4 

Program implementation and adjustment are discussed in Part IV. 



Table VII -3 
Arrangements That May Increase or 



Decrease Behavior 



To Increase ; ' 

1. Reinforcement 

a. Social* . ^ 

b. Activity 

*c. Concrete 

■d. Indirect 

I 

2. Prompting (Priming) 

- r • 

«i. . .Verbal 

y 

b. Nonverbal 

c. Modeling 

3. Shaping 

a.^ Shifting criterion 



b. Chaining (Cask 
analysis) 

To Deer ease : 
I. Extinction 



2. Time out 



2. 



3. Punishment 3. 

4. Response Cost 4. 

5. Inccmptatible Behaviors 5. 



Definition 

An increase in behavior pToduced by 
consequences: 

.a. social events delivered by someone 
else 

b. doing sometliing which Is preferred 
or desirable 



g. receiving edible or material awards 

d. tokens or symbols which are exchange- 
■able for other consequences 



Making changes in the cues for behavior 
to Increase the chances It will occur 

a. saying or writing directions, explan- 
ations,, or Instructions for perform- 
,ance 

b. doing something to ensure performance 

r. presenting an example of the desired 
performance 

'Gradually building a desired performance 
by beginning with behavior already In the 
student's repertoire 

ai increasing the duration, percentage, 
or frequency necessary for reinforce- 
ment 

h. requiring that two or n.ore snaller 
behaviors occur In sequence for 
reinforcement \ 

pejClnlt ion 

A decrease In porforma^-e produced by 
wi thholding' consequeiw'es which have pre- 
viously rei,nforced th\t performance 

A decrease in performarice produced by 
not al lowin g any behavior to occur & be re- 
inforced as a consequence of that perform- 
^ance 

Decreasing performance by making n con- 
'sequence contingent upon that, behavior 

Decreasl.^ performanc* by taking away 
something as consequence for performance 

Decreasing one behavior by reinforcing 
«'Jnoth9r behavior which. If It occurs. 
Interferes wl^h doing that behavior . 



^ Example . . v - 

Increasing completN^n of* school tasks by: 

a. . Praising, attendli^g to, interacting With, or 

touching someone who completed his sChoplwork 

b. Increasing correct iproblem solving by allowing • 
students 3 minutes If ree time for every 10 prob- 
lems solved correctU.y 

c. .Iiicreaslng spelling (accuracy by awarding "Snoopy 
Stickers" for spelling 9 of 10 words correctly 



, d. 



Increasing "in seat"! behavior by occasionally 
giving points to students in their seats to 
exchange for social, (activity, or concrete 
consequences 



a. Saying "Everybody watdh n.e and I'll show you a 
picture" \ 

b. Writing In the air, tricing,- counting on fingers 

c. Presenting a syllableipard, saying "This is sat, 
now you say it'* / 



a. Increasing by 5 minutkis the amount of continued 
"in seat" behavior necessary , to earn a token 

b. Teaching single sy ll^/iblje regular words and re- 
/|ulring the student 'to "sound out" polysyllable 
words 

Example 

1. Decreasing "In seat" behavior by never paying 
any attention to it or p-aising it / 

2. Decreasing "throwing object?" by having the stu- 
dent sit by himself In the back of the room for 
3 minutes asi a conseq ence 

3. Decreasing c "npletlon of worksheets by giving 
additional work to students.when they complete 
their worksheets 

<». Decreasing "hitting" by having student lose 
tokens for hitting o 

5. Decreasing "out of seat" behavior by awarding 
tokens fdr being In tlie seat 
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and V^ B both agree 



on ihe follow/ng: 



1. If R,cky Works (Quietly all morrnntj 

Afe B wj/l ask £j£ky^^ io choo^sc ihc 
^ame the c/ass- i^ill plo^y at lunch tcccss 

Z. If Ricky works c^u/eily for five days 
j/jfe-.^ u//// 3c^d a /loie home to 



R \ C K V 

StudeaVs name 



- :..i.iii.Mii i—iir-i ■ I 1-^ • ■ ^ ' 

Teacher's narm' 



Fig. Vll-I. Contract for the decre^jsc* of nois<> '»n . 'j^sr'Y.^-^ r^ft M^fr^ .u--.* \y< \ ^ 
spec i n ed rcv/ard<i * 



1 1 
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DIRECT 
. SERVICE TO 
THE TARGET STUDENT BY 
THE SERT 



INDIVtDUAL 



GROUP 



■INDIVIDUAL 






INDIRECT^ 
^ SERVICE TO 
THE TARGET STUDENT BY 
THE SERT THROUGH CON- 
SULTATION WITH CLASS- 
ROOM TEACHER; TRAINING 
OF AIDES;. VOLUNTEERS; 
PEERS/CROSS-AGE TUTORS 



GROUP 




IN ROOM 
OUT OF ROOM 
OUT OF ROOM 
IN ROOM 

IN ROOM 
OUT OF ROOM 
OUT OF ROOM 
IN ROOM 



Fig.^Vll~2. Alternative administrative arrangements: eight styles of special education service 
within the mainstream. (Adapted from E. Joseph, A description and an implementation 
evaluation of the Seward-Un ivers i ty Project. Unpublished Master's paper, Department 
of Psychoeducational Studies, University of Minnesota, I97A.) 

classroom teachers) in consultation with the SERT, or in which the SERT trains others to implement 
the program plans. (SpQCific procedures for consulting with classroom teachers and training others 
to iipplement DBPM are discussed more fully in Part VII.) [ 

Different administrative arrangements rruiy be appropriate for different content areas. The deci- 
sion on which arrangement to propose or accept should be a collaborative one between the class-- 
room teacher an^^ the SERT, with due consideration given , to selecting the arrangement which is the 
appropriate and "least restrlctxvV" one for the particular student.^ 



For 'Ricky, two alternative administrative arrangements were proposed by the SERT for each 
academic behavior. Only one arrangement was Apropos ed for social behavior. 
Reading : 

Arrangement 1. Daily dlreci: service by SERT in regular classroom. 

Arrangement 2. Daily indirect service by peer tutor monitored by SERT icO resource room. 



Math : 

Arrangement 1. 
" Arrangement 2. 
Noise : 

Arrangement 1. 



Daily 'direct service by SERT in regular classroom. 

Dally direct service with. three other pupils by SERT in resource room. 

Indirect service by SERT through consultation with classroom teacher 
(see Fig. VII-1). ^ ■ , ^ 



The definition of least restrictive alternative, 
policy of educating all handicapped children "to 
who are not handicapped. 

i nr. 



as given in P.L. 94-142, clearly establishes the 
the maximum extent appropriate" with children 
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CASE REPORT SUMMARY SEVEN 



Student 



Grade 



Age 



Teacher 



5. What program plans ^are proposed? {cont.) 

What resources are avai lable to implement the plan? 

Propose several possible prrgram arrangements here 



Behavior 


^ Program 
Arrangement 


Tvnp of Instructi on 


Time 


Implementors 


Place 




1 ' 


(oTrect) Group 
Indirect Mndividual^ 


19:50- 
n:co 


GikO aide 
class teacher other 

PEER 


Resource Room 
^^assroom^ 




Other 


2 


D i rect Group 




^ERT) . AIDE 


/l^esource Room) 


(Tnd 1 rec^^^ndjv^i 


CLASS TEACHER OTHER 

(eeeT) 


Classroom 
Other 




1 


(direct) Group 


moo- 


(sert) aide 
class teacher other 

.PEER 


Resource Room 


Indirect ^ndi vidua?) 


(^Tassroom) 




Other 


2 


recT^ ^roup^ 


/r.00 - 
ir.30 
t>^»'ly 


(|eRt) AIDE 
CLASS TEACHER OTHER ^ 
PEER 


Resource Roo^ 


Indi rect Individual 


^ Classroom 
Other 




1 


Pi rect Group 


] 


^ERT ^ AIDE 


> 

Resource Room 


^j^d^i^ec 


^ASS TEAChT^ OTHER 
PEER 


^^Uassroo^ 




Other 


2 


Di r.ect Group 
Indirect individual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


Resource Room 
Classroom 

Other 



Date Completed 
By 



75- 



1 5b 
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^ ' ' Overview: Measurement 

Measuring progress on a daily, weekly, and monthly basis has been demonstrated to be a 
critical component of I)BP^f. "u insure uniformity of measurement throughout the program as part of 
the program plan, the SERT must specify* which of the graphs developed during initial assessment 
will be maintained during the program and how often and in what manjner the data will be collected. 
Additional graphs may also be constructed if they are needed. • 



CO 

|| 

g CO 
ft; ^ 



PROCESS: Meas uremen t 



QUESTIONS ' 

6. How wi 1 1 effectiveness 
of progra/Ti plan be measured? 

What procedures vn 1 1 be used 
to measure progress/perform- 
ance? j 

How often will data be^ 
collected? 



What progress/pe'-formance 
•tC/.W estimated? 



MATERIALS NEEDED 



Guiidel ines to select - 
mea^surement procedures . 



ACTION REQUIRED 



Specify procedures to 
measure behaviors and fre- 
quency of data collection 
on Case Report Summarv 
.Eight. 0 ■ 



Proceaures to draw pro- ^ 
jected progress/perform-, 
anr^^ estimate on graph 



Draw projected progress/ 
performance est i ma tes on 
graphs. Q) 



ERLC 
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Several factors must be 
considered in the selection of 
the method and frequency witli 
which data are Collected: 

1. The opportunity available to measure the behavior (i.e., the frequency with which jc^e" 
behavior can occur).. If the student is seen for instruction onlV' weekly, a dally measure is ruled 
out, obviously. . ■ . 

2. Whether progress performance is being measured. Progress graphs usually span longer 
periods of time and measurement may be less frequent. 

3. The frequency with which the behavior is likely to change. Behaviors that change frequent- 
ly should be measured more frequently, A general rule of thumb is that the more frequent the 
measurement, the greater the sensitivity of the measures to changes in progress/performance. 



EXAMPLE 



In Case Report Summary Ei^ht, there are listed the procedures that will bemused by the SERT 
to measure Ricky *s progruss/pLrform.ince. Nute th.it in addition to the monthly progress graph for 
reading in the Read Surius, which was developed during initj.al assessment, the SERl will maintain 
a daily progress graph as well. In thus instance the daily progress graph will help to monitor . 
the estimated daily mastery goal of 6.5 pages/day. 

For math facts and noise behiivior, the graphs developed during initial assessment will be 
continued. ^ 

15 7 
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Reading \ ^ \ 

1. On the first d^y of each month the SERT will plot a point on the monthly progress graph 
to represent the mastery level which Ricky has achieved. , ; ^ 

2. fiiich day Ricky reads, the number of pages mastered will be determined by the .mastery 
criterion (50 words or better/min. with 2 or fewer errors ancr80% comprehension) on a , randomly sel* 
ecte'd paragraph, from the pages. These pages will be added to the cumulative total on| the dajl'j^ 
progress graph. v . ; 

Math Facts 

Each day Ricky will respond orally for one minute to a randomly selected set of addition and 
subtraction math facts with sums from 0-19. The number answered correctly and incorfectly/min. 
will be entered on the graph. 

Social Behavior ^ \ 

Each week the SERT will observe Ricky and his peers in the classroom for 10 minutes daily 

for noise behavior. Ricky will be observed for 5 alternate minutes and his peers for 5 alternate 

minutes. The data will be .ummarized and entered on the graph by the SERT and subsequently 

shared with the teacher during consultation. 

This information is Summarized in Case Report Suiiimary Eight. 

0 Procedures to Draw Projected Progress/Performance 
Lines on Graphs. See Chapter III. 



The projected CiSLimates made by the SERT for Ricky's three pinpointed behaviors were added 
to the relevant graphs. 

Reading . The intervention period selected by the SERT for Ricky's accelerated progress in 
the Read Series is 9 iionths. At the end of this period, desired mastery for Ricky is completion 
of Lhird-gr*ulu reading Uvcl or Book I. This point is shown as A on tjie graph at t'.ie intersection 
of end of ^^radc 3 (27- months) and Book I Ric ky's present mastery level is the fourth month of 
first grade or two- thirds of tlie way through Book C. This point is shown as Oon the Rraph at 

the intersection of beginning of grade 3 and page 60 in Book C. A dotted broken line ( ) 

is-drawn between 0«i"d A . See Graph 12c. 

The- estimated progress for the 9-month intervention period is based on mastery of 6.5 pages 
{)er day. To munitor Ricky's daily progress, the SERT set up a daily progress graph in reading. 
On the vertical axis, the SERT listed the books and pages in the Read Series with each line 
representing 6.5 pages, beginning with page 60 in Book C. Thus» the to'tal pages on the vertical 
axis equal 637 (40 pp. for Book C, the total of 100 less 60; 190pp. for Book D; 222 pp. for Book 
E; and the first 185 pp. of Book F) to he mastered in the 98 days of the 20-week intervention 
period. The weekly dates were written in on the horizontal axis. 

SERT planned on starting the intervention in reading during the week of September '23. Thus 
the SERT estimated that the 20-week intervention period would tnd February 19. Therefor<^, the 
SERT placed Z\ at the intersection of 646 pages and 20 weeks after tlie start of the intervention; 
Owas placed on the graph at the starting date of the intervention., A dotted broken line 
(-.-..«.-) y^^^ drawn to connect the two points. See Graph 12c-l. 

An the end of 20 weeks* a new graph of daily progress will he organized to start with p. 186 
of Book F, and a new estimate of progress will be drawn* as in Graph I2C7I. 

Computing Math Facts . The SERT had chosen a 10-wegk intervention for Ricky for the computa- 
tion of math facts. Using the equal ratio performance graph* the SERT marked off 10 weeks from 
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CASE REPORT SUMMARY EIGHT 
Measurement procedures' to be used in the program are sunvnarized here. 



Student . Grade Age 

6. How will effectiveness of the program plan be measured ? 
What graphs will be maintained for the prograf^? 
How often will data be collected? 



Teacher 



: I 



Behavior 
to be 
measured 


How materials 
"are organized 


What the 
teacher says 


What the 

student 

does 


Type of 
graph 


Frequency of 
measurement 


What is " 
recorded on 
the graph 




/?e/5o' Series 


X-nroc cjoJ 
for / ro/n. 
Then Z'// 

sortie. , . ' 


/?e/)c/s 

sejecf/oo 
for J 

n/'n. 
finsuicrs 


IProgres^^ 
Performance 


(oan^ 

Week ly 
(^nthly^ 


^. of 

^^^^ 




of SO 
rA/lolomJu 

r*>/^A -fAciB 


P/e/)se 
OJr/'-^e i'/it 
/)/^£u)er<, 

to fAese 
/n^M -ffich. 


finsLoers 
■for / 
r*)/r)ore. 


Progress 
Per formancej 


^My^ 

Week 1 y 
Monthly 


/ritCrreCT 

jp^trnifHjft 


in 


peers ito 
Cf/^isrooro. 


TeficMr 
Ohser^S 
■for /o 
ni/iofes. 




Progress 
Performances 


Da i 1 y 
f^Week 1 y\ 
Monthly \ 


per n/n. 

ypffe of 

b^A/^Wor 
for P^u 



This case report summary is an adaptation of a recording format presented by .1. E, McCorrydck, 
Jr., The assessment tool that meets your needs: The on^ you construct. 
Children, 1976, ^(3), 106-109. 



placed a at the intersection of tho line representing 10 weckti after the start of the 
intervention and the 'line representing 20 facts/min. , and a Q P"^"^ repro^t'nt 1 n>'. i 

present median. A was drawn to connect, tlie two points. See graph I5b. 
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SCrif00L:Rlvei? RUM 




CURRICULUM: i^EAOlHG 



A OeSlRFD LEVEL 
0 PiCTUAU LEVtzL 

ESTIMATED PR06«E» 

LIKE 



TIME IN SCHOOL ( YEARS ) 
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GrapN 12c. Monthly progress gr^h, Read Series, showing nonintervention progress line 
and estimated prog-ress line, for Ricky. 

Noistj . For noise a nine-week intervont[on period was .selected. At the end of this time 

r 

period desired noise behavior for Ricky is . 2/minute (Peer noise bthavior)., Tliis Roal is shown 
on the RrJiph as a A at a point nine weeks following baseline at the .2 Line on the graph. A 

dotted lint' • was drawn fri>m tht^ present median of 3, ropreiiented by a C,to the A - See Graph 

19b, pagJ 1A8. 

The,'SERT then complcteJ Case Report Summary Eight listing the specific activities for measure- 
ment and! data recording for eacii behavior. 
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PRU'JE^'c: . Cprriun i t i on uACol ' • ihova t i 



on 



QUESTIONS 

7. Does the program plan 
meet the expressed needs 
of referrer; student; 
parent; others? 



MATERIALS NEEDED 

Purpose ofprogram plan 
review. rTi 



ACTION REQUIRED 

\ 



Have a 1 1 part ies been 
involved in planning? 

Have all parties 
accepted plan? 



Form to receive feedback 
on program plan. (Case^ 
•Report Summary Nine) 



Circulate Case Repo\t 
Summary Nine to {nteV- 
ested parties. \ 

Arrange program plan "\ 
staffing if required.^ 



\ 



1A5 



E 

w 
w 

o 

c 



CO 
CO 

o 

w 
O 



STUDENT: RxCWV 



SCHOOL: Rivrf^^RUN 



CURftlCULUM: READ Strict 

Key 

ESTlMKrED 
PROGRESS 
L5Ki£ 



/ 



t ♦ ♦ ♦ < f 
'i JTO «f 39 »€ 



4 



M (f 7i K AS f • H 

^^/« '^/» 'rro U 'Vis "Zap 't<27 'Vy 'V^s '// 'A J^i Vx9 

^ Time in School (Days) 

Graph 12c-l. Ricky's daUy progress in Road Series showing est imated progress 
line for ^intervention. 



Purpose of program plan review. 



Thus the 



The program plan review is designed 
to insured systematic feedback on the extent 
to which the planned program is meeting 
the expressed needs of all parties, and" to 

permit some choice about which administrative drran^ements will be implemented, 
collaborative nature of planning is coi\firmed. ^ 

Program p.'ans must adequately reflect the concerns articulated during the problem selection 
phase of the program. The exhaustive nature of these activities can be Justified only if the 
resulting plan is more appropriate fcr the student and satisfactory to the student, teachers, 
parents, and others than would otherwise have o<^c iir red . To expedite implementation of the progr^im. 



the plan is circulated to the relevant persons and tTTeXr approval, reactions, and preferences , are 
solicited. If the administrative arrangements selected by all the parties is not tiie same or the 
program objectives or changes are rejected, these differences are reconciled informally or at a 
review meeting until agreement is achieved. 



- 6: 



.L. guarantees parents the right to participate in al 1 dec isions regarding their child's 

^ p nog riiin^ including the right to participate in planning the educational program. 
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STUDENT :R\CKY 
^^^^^^ 



u 
h 

Z 

Z 
> 

i 

Z 

O 

< 

O 



Ul 

£ 

St 



SCHOOL :R\^eR RUM 



j^CURRICULUM: MATH C<p^PUTyHTTDA/ 

key: 

<? MEDIUM t CORRECT 

DESIRED fWWWWoE 
. ESTIMATED PERFOWWcP 




9fry 9/11 9iz9 /0/6 /0//5 /fl//a ro7z7 ////o ////7 ///^V //// ////it /^//^ //6 

Successive Calendar Days 
Graph 15b. Daily performance graph for computation of math facts/min., for Ricky. 
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i EXAMPLE i 



The plan the SERT ueve loped for Ricky and summarized in Case Report Summaries Five, Six, 
Seven, and Eight was circulated to the team, for approval. The SERT' and the classroom teacher 
then hiild a conference with Ricky and his mother. The plan lias explained and both Ricky and his 
mother weru asked whicli administrative arr.ingement they preferred and whether program objectives 
and changes seemed appropriate. Their preferences are shown in Case Report Summary Nine. 
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CASE REPORT SUMMARY NINE 

This form is used to solicit and record feedback on program plan from interested 
parties. 



Student 



. Grade 



Age 



Teacher 



\ 



Does the program plan meet the expressed needs of ttie referrCr 7 
student? parent? othoirs? 

Have all parties been invQlved in planning? \ 
Have all parties accepted plan? 



Oi rcct ions: 



Circulate proposed plans (Case Report Summaries Five, Six, Seven, and Eight) to ^ 
interested parties and solicit their program plan preferences on the form below. 



Enclose are the plans which have been proposed for 



1^ 



program. Please 



read them and indicate your approval or disapproval of the plan and your choice of administrative 

arrangement. If you |iave concerns about the plan wi»ich need to be communicated in persoh, please 

<• - 

stop in to see me in the resource room any morning before the start of school or call me at 
37^**3Qy/ • plans are not satisfactory a team meeting will be arranr d. ° 



SERT 



Date 



9/d>7/7S 



ERIC 



t have read the enclosed plans. 
My preference is as follows: 



Preferences 



Behavior Program Arrangement 


<;iass Teacher 


Parent 


Student 


Other Team Members 
























2.DvVcd"; gvoup 




















lXv\diiV«ct;ivvifviidiBl 

> 






/ 












ACCEPT PROGRAM OBJECTIVES 
REJECT^ - - ^'^^ CHANGES ^ _ 



















Please return to the SFRT's mailbox as soon as possible so that the program may begin. 
Program Plan: Accepted 



Date 



To meet requirements of P.L, 9^-1^2 a staffing may be necessary here. 

iU3 



STUDENT: Ricky 



SCHOOL: Se^Ces 




.001 

.000695 



CURRICULUM: Noi^ 



Key: 

i PEERS 
^ RECORD FLOOR 

iC^MeDiJ^NtTARerr 

^ MJ?£>lAN : PEERS 
|^CrtA,M6f UWE 

RFORNAMce* 



Hnr i^ m .|> iu |i ni ,*i it tii H (i 



0 10 20 30 40 50 60 * 70 80 90 100. 110 120 130 140 
9//$- ^» 9fzf folb tt/i3 mio ii/z7 //J3 iiln itltr a/i n/$ ttit$ lUux nj9$ il^ da fti^ ifki ifs 



' • Successive Calendar Day^ ^ 

Graph 19b. Daily performance graph for Ricky and peers, noise in classroom showing estirtated 
performance 1 ine for entervenj Ion. ^ ^ 
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' PART IV 

Developing' Skill 3 in DBPM: 
Program Operationalization* Phase 



The best laid schemes 

o' mice an* men 
Gang aft a-gley. 

Rol)ert 'Burns 



& 0 



& 
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' . ' IntYodu^ion 

The four key elements in the program operational izat ion phase of OBPM are as follows: 

K Goals must be cledrly^lden^t i f ied and progress on the goals must be measured frequent ly » 

^ * \ 

A major, reason for instructional failures is that goals are only generally defined and 
\ ^ • ^ • ' 

prdigress is rijeasgred only occasionally (Bohannon, 1975; Hofmeister ^ Crutcher, 1975; Jenkins £ 

Gorrafa, 197^)» Although teachers often be'iieve that daily I nteract ion wi th students provides 

suffi^cient basis for evaluating student progress, the belief is founded on fafth-, not facts. Goa] 

setting and measurement, which are discussecj. in earlier sections of this manual, are^^sent ial 

to any attempc to change students* progress/performance. " 

2. A/program ynust be held constant long enough for its effects to appear . 

When "teaciers decide to initiate new programs for children with learning difficulties, it is 

np.t, unusual f o • them to change different aspects of the programs on an almost daily basis ir> 

tl^ir zeal to nake » difference i,n the children's prqgress/performance. Sbch frequent changes 

in instruction are sel f-defeat fng , however, for two reasons: .(a) the effects of the changes cannot 

be evaluated ,cnd thus (b) any potentially beneficial change may be discarded* before it is iden- 



tiffed.. Often 
dai 1 y . instruct, 



teachers attempting DBPM for the first time find it difficult to be consistent in 
on because t'h.ey feel frustrated when immediate results are not" apparent . Yet, once 



they donqtter these initial frustrations, the same teachers find it possible and rewarding to 

o * 
adhere to system^ ic consistency. . - ' ^ 

3. Data should be used to mak^ program-change decisions, but somL aspect of the program should be 
changed 'every 15 school days (3 weeks) or after 15 data points, whichever comes first . 
We recommend as "a /uleof thumb" that a program change be made aoy time three successive data 
points fall be!ov/ the projected progress/performance line (Bohannon, 1975). We also recommend that 
regardless of how well jtne program may be going^ some aspect of the, program be changed every 15 
•school days or daCa 'points, whrchever comes first. 

These recommendations are not difficult to follow, given that most teachers change many 
aspects of programs daily. However, it may be tempting to hold a program constant when a change 
is leaoing to problem solution. Still, we cannot knov^whether a current program is the best pos- 
sible one unless we regularly make changes (every IS days or data points) in at; least ^ome aspect 
of the prdgram to see wh^ther^ an 'mprovemertt is possible. Call this procedure "tinkering," if you 
like, but It fs an essential procedure in DBPM. Remember, we arc suggesting program evo 1 u t i on 
not revolution. For example, simply increasing or decreasing the amount of time that is spent 
'each day on a particular instructional activity is a change, and it may lead to improvement. When 
you make a change that decreases progress tov;ard goal attainment,^ypu are always free to change back 
to your .previogsl y more successful program after plott ing three succesVi^e data pqints below the 
line~-and that is another change 1 * \ ^ * * 

A. Periodically review program activi ties "to insure that t^he pr ogram is being^\mplemented accord- 
ing to plan and is agreed upon by those concerned with the referral . 

The effectiveness of a carefully planned and selected program can be tested only if.it is 

fully implemented. We find off^n that a true test of a pi'ogram has not been made because tn^ 

people who are responsible for carrying out important aspects have not done so according to the 

plan.. With periodic revi^ews, the extent to which the program as planned is being implemented can 

be evaluated and any differences which are detected can be reconciled. Periodic reviews increase 

f, * 
the likelihood that an adequate test of a pojtent ia 1 1 y beneficial program will be made. In addition^ 

■ " "16b ■ 



by^ f Qf ma 1 i 2 i ng communication among the persons interested in the student's program, periodic r 
views prompt and reinforce the sharing of responsibility which was initiated during problem an 
program selection. / , 

These four points are discu^jsed in detail in Chapter VIII. 
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Chapter VI 11 



PROGRAM 0PERATI0NALI2ATI0N: 



MEASUREMENT,, EVALUATION, AND COMMUNLI CAT ! ON AND ^ COLt ABORAT 1 0N 



Decision Area: 



Progrcun Opevationalization 



Overview of iMeasurcmcnt 
During program operaticnalizacibn, meaBurement« are taken 

on the behaviors which have been selected for modification in 

the agreed-upon program plan. 

The guidelines for managing these data--collect Ion a^ilvUlt^tj 

and the decision rules for making program changt-u ax:^ dinvuH^etl 

in this chapter. ^ 



PROCESS: Measuvemen t 



O Co 



!5 

i 



QUESTIONS 

9. Is program being 
implemented as planned? 

Are measurements being 
taken? Are graphs being 
maintained for each pin- 
pointed discrepancy? Are 
delta beitig recorded as 
planned? 



MATERIALS NEEDED 



Guide) ines for imp- 
lement inq data collec- 
tion act i vi t ies . 



Evaluat ion 

Col I ii^O* <st ioo 



ACTION REQUIRIO . 



<j.»'aph% . ' 



tot 1 

O 



Are program change*^ being 
made based on graphed 
data? Are changes 
noted on graphs? 



Decision rules for m,iJ »fi*j 
proqraiT) changes 



on iUKA 



Qj Guidelines for Impl ement ni^ • 
Data-Collection Activities 

\ 



Th<" following K>»t >»/! Ir|, ! i n* ^ i •, t r*h»u^- 



. When the SERT Collects the Data 

. During implementation, data are collected and recorded so that pr9gram~change decisions can 

be made. Here are some guidelines to help to organize data-collection activities. 

. ^ 1* Choose the graphs you will use carefully. 

' Try to keep no more than four graphs for any one student on the behavior (s) of interest, for 
example, if improving reading skill of newspapers is the behavior of interest, measure thi& , 
behavior only. It ^'s not necessary to grat>h phonics skills if you have chosen to teach phonics 
as an intervention t6 improve oral reading qf newspapers.. 

2, Be organized, ' ^ ' 

a. Keep- each student's graphs in a folder with his daily work for easy access. 

b. Encourage students to assume responsibility; let them bring their folders to, the SERT \^ 
when the lesson begins and return them when the lesson is over. ^ 

c. Keep timers and pencils accessible; wear them around the neck, for example. 

d. Record data directly on the graph when the measurements are taken. Do not allow data 
to accumulate on separate sheets of paper. Transcribing information is more time consuming and 
it is aversive enough to insure that it will not be done. 

'e.* Each timt a change is made in the stuaent's program draw a vertical line half-way between 
. the last data point of the previous cha.ige and the first data point of the new change. Label the 
change directly on the graph.. 

f. Compute the discrepancy for each change directly on the discrepancy worksheet. 
g* Include the necessary time for collecting data in your lesson plan. Do not try to 
- " fit it in if there is time left over! 

^* Set aside a regular time period to summarize and review data. Again, do not try to fit 
it in. Summarizing and reviewing data must become a valued and legitimate r reparation activity. 

3. Train others to collect data (see Part VII). 

a.. Train students, peers, cross-age tutors, and volunteers to collect and record data. It 
has been demonstrated by Starlin (1972) and otlicrs that even first graders can be taught to 
. graph data! 

b^ Persuade the math teacher to develop a unit on graphing which will be taught in the 
qlassroom for 15 minutes each day and include practical experience. 
- A. Persuade others of the usefulness of iata collection for sharing^ repor^'ng, and accountability. 

a. Using data decreases the amount of time it takes to make program decisions. One look 
at the graph is usually all that is needed to determine whether a program change is warranted. 

b. Whenever you can, summarize data on the Discrepancy Ratio Worksheet for parent conferences 
and staffings. "One look is worth a thousand .words. 

c. Include the graphs and Discrepancy Ratio Worksheet in the student's permanent file to . 
decrease the duplication of record-keep-ing activities." 

When Someone Other Than the SHUT Collects the Data 

Since the SERT assumes personal responsibility for insuring that programs are implemented as 
planned, it may be valuable to review some of the common problems SERTs have encountered in 
trying to help others manage the data-collection activities. These problems and some possible 
solutions are discjssed briefly in Table VlXI-i. The list is not exhaixstive, of course. In Part 
VII on consultation and training, further discussion is presented on how to i>olve discrepancies 
pnYp"^^"®®" program plans and program implementatior) when others are implementing the program; 
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-^able VIII-1 
Implementation Problems and Possible Solutions 



Problem 

1. The program is 
implemented but pro- 
gress/performance 
is- not measured. 



Explanation Offered 

Implementor cites lack of time; 
concern for extent to which 
measuring performance detracts 
from instruction. 



Student objects to having per- 
formance measured. 



Solution by SERT 

Trains students, peers, cross- 
age tutork, volunteers, and aides 
to measure performance. 

Observe measurement procedures 
and help to develop more effi- 
cient methods, if possible. / 

Offer training in evaluation pro- 
cedures as a method to improve 
instruction and not to detract 
from. instructional time. 

Manage the implementor class 
for a few minutc*s each day init- 
ially while he/she iHeasures per- 
formance, and then gradually^ 
withdraw. 

Prompt and socially reinforce 
all measurement attempts by the 
implementor . 

Write contract with student. 



2. The program is 
implemcntud ; measure- 
ments are taken; but 
data are not recorded 
on graphs. 



Implementor cites lack of time. 
Dataare placed on recording 
forms instead of on graphs. 



Implementor cites lack of 
chart ing skills 

Implementor appears disinterested 
in data or does not see import- 
ance of recording and graphing 
data. 



Manage implementor * s class for 
a few mintues each day initially 
while he/she graphs data, and 
then gradually withdraw. 

Keep all graphs in a looseleaf 
notebook for easy access and 
record all data directly on 
graphs. 

Train others to record data. 

Teach charting skills. Model 
charting behavior by providing 
samples. / 

(SERT and principal) prompt and/ 
reinforce data recording and / 
graphing by "stopping by" to ' 
inspect graphs each day. 



3. The initial pro- 
gram change is imp- 
lemented; progress/ 
7;erformance is 
measured ; data are 
recorded but addi- 
tional changes are 
not made as planned. 



Implementor states that the 
student is already making 
satisfactory progress. 



Imp lementor bel ieves program 
changes are unsettling to 
student . 



Implementor lacks skill in think- 
ing of appropriate cht^nges. 



Review discrepancy data and pro- 
gram plans with implementor and 
others involved in problem iden- 
tification and program selection. 
Determine if all are satisfied. 
If not, write a contract to be 
signed by all concerned parties 
(including tht implementor). 

Socially reinforce implementor 
for being concerned; arrange 
to review changes with student 
and/or suggest using the data to 
determine the effects of fre- 
quent changes. 

Consult with implementor. Organ- 
ize several changes for implemen- 
tor. Prompt and reinforce all 
efforts by implementor. Share 
simple "how to" articles appro- 
priate tv the problem. 
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Decision Rules for Makinii ^) 
Progrnm Changes 



When a plan has been implemented -and the 
data are collected and graphed, the data are 
used to determine when to make program changes. 
Based on the work of Bohannon (1975) and the rules 
for making data-based decisions discussed by Liberty (1972), we recommend the following two rules: 

1. Make a change whenever three successive data points are plotted 
below the estimated progress/per formance -linc.^ 

2. Make a change after plotting 15 data points or after three ' 
weeks, whichever comes first. 

Each time a change is made, be sure to record the new discrepancy on the Discrepancy Ratio Work- 
3heet. 



Changing the Hstimated Progress/Performance Line 

When three successive data points are plotted below the estimated progress/performance line, 
necessitating a program change, a changt Is also required in the estimated progress/performance 
line. The new estimate is drawn parallel to the original line beginning at the last recorded data 
point (see Graphs 12e-l, f-1, g-1, in Part V). 

The new estimate adjusts the original objective to the student's actual performance. When 
the initial estimate is computed, tnere is little information on which to evaluate the student's 
progress/performance on the specific obje*^Ives proposed. At best, the initial estimates are 
educated guesses that are based on the team's evaluation of the importa'^ce of the , problem, the 
time available for the intervention, and the size of the discrepancy.. In practice, when the esti- 
mate is consistentl> not achieved, it is a signal that the original estimate may be too -high (or 
too low, if progress/ performance is consistently and markedly above the estimate). The new esti- 
mate, therefore, is drawn to accoinmodat'e the actual, performance of the student. 

Overview of Evaluation 

During this phase of program oeprat ional ization, the extent to which the program is being 
implemented as planned is evaluated. 

The four questions which are answered arj^ .shown in the matrix. When discrepancit^s between 
the program plan and its implementation are detected, the Mif f erences are reconciled or justified 
through the review process. 

PROCESS: Eva luaiion 



« +^ 
« S 

& 'ri 

9 « +i 
P. S S « 
CJ) O ^ 3 
O 'ri ^ ^^ 

Sh S t«3 

^ fx. 
^ 

CO ^ 



QUESTIONS 

10. is program plan 
implemented as proposed? 

Are there a sufficient, 
number of -data points 
for each intervention? 

Are program changes 
frequent enough? 

Are changes made 
according to decision 
rules? 



MATERIALS NEEDED 



Guidelines for reviev/ing 
data. Q 



ACTION REQUIRED 



Review graphed data and 
compare with program 
p Ian. 

Complete Part One of 

Case Report Summary Ten Qj' 



^ After three changes have been made, the data for each change will be, reviewed to evaluate which 
gp^^^"changes have been successful. These procedure are discussed in Part V. 
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Guidelines for Reviewing Data 



summarized on Case Report Summary Ten: 
,t Data Required 
1. Data relating to measurement 

a. Are there graphs for all pinpointed 
behaviors selected in the program 
plan? 

b. Is performance being jneasured? 

y 

c. Are data recorded on graphs. 



Data relating to change procedures 
a. Are the changes identified on the 
graphs? 

h". Havre program changes been, made 
according 'to the decision rules? 

c. Are the changes those specified 
in the plan? 



One of the best ways to determine if a 
program is being implemented, as planned is to 
review the graphs which are being' maintained 
for the program. The following data should be 

Procedures for Review 

'''iere should be as many graphs as are listed 
in Case Report Summary Seven. 

I Compare the program plan with the actual 
measurement data which are availably. 

Each graph should" isontain daily/weekly/ 
^ monthly data points, depending upon the 
type of graph and agreed-upon measurement 
procedures in Case Report F mmary Seven. 

Check the graphs for vertical change lines 
indicating that changes have been implemented 

Count number and location of data points. 

Compare program plan with implemented 
changes. * 



The frequency with which the formal reviews of program implementation occur depends entirely 
on the individual or graup responsible for managing the program. We recommend the first review 
within two weeks of program implementation and, again three to 'four weeks later (when necessary). 
Subsequent reviews are discussed in Part V. 

I EXAMPLE ^ - - 

Two weeks after Ricky's program was impiemonted the SERT reviewed and summarized the data 
recorded on Graphs 12d, i2d-l, 15c, and 19c. 

This information is summarized iA Case Report Summary Ten. 



ERIC 
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STUDENT :«.-<kyg^^ 



SCHOOL: Rfvev Run 




CURRICULUM: Rcad SsrieA 



KEY' 

MASTERY fOlt A6^«M0E' 
0 hCrUhL LCV6L «P 



\ 



Graph ]2d. 



l{l*)»Jt i41*}«Tt l{J***Tt t<>*S«Tt l<l*»*T« 

'l 2 3 4 5 6 

Time in School (Years) 
Ricky's monthl/y progress graph, Read Series, first review. 



STUDENT: 



SCHOOL: RW^r 



CURRICULUM:f?G5di ScrfW 



1 ♦ 



E 

3 



3 

o 



CO 
CO 

o 

a» 
o 




PASes MA5TE<?FD. 
^ (CUMULATIve^ 



^ ^ 5 10 18 25 30 3« 40 46 «D 55 40 65 70 75 |0 $f 90 55 

/ ♦ ' /0/2 /c/3 ioltSj»l39 «/4 ''/'J 'Vi?o 'V/r //A ^;^/// ff//^ »li fit fl'S tl2l 

Time in School (Days) 

Gragh I2d-1. Data points recorded for Ricky's daily progress in Read Series , at first review. 
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STUDENT: 



SCHOOL: R»vcr Run 
8 



CURRICULUM: Ma-tV\ Facta 

■ 12 16 

m: 

A INCORRECT 
£^ M^JAM'. IMCOR.RFCT 
^ ESTIMATED Tfi?R3RMW(r 



I 

a 

a- 
< 

t 
c 

7L 




\S 



1000 



MWf MWF MWf IMWf MWflMWF MWf jAAWf MWf lAAWf MWflMWf MWf Iwwf MWfImWF MWf| 

.0 7 ' 14 I 28 ' 42 • ' 56 ' 70 ^ fi4 ' PR ' no ' 

Successive Calendar Days 
Graph 1,5c. Data points recorded for Ricky's daily performance, Math Computation Skills, 
. f i rst review. 

STUDENTrRick/ SCHOOL :f?iVc*r Run CURRICULUM: Noi^ 

Omw^. ' k 8 12 16 20 




^ 'l^' n. .ti. .1, .1. .t, tr, m. .ftr. .r* .ti n. ,tt. n. 

• ^O*. 20 30 ,^40^ 50 -^60, 70 80,. 90 100 110 120 130 140 

Successive Calendar Days * ^ 
Graph 19c. Data points recorded for Ricky and peers,, nojse'^in classroom, first review. 

174 " 
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Overview of Communication and Collaboration 

During tjhe first six weeks of program operation several meetings are convened to evaluate 
whether the pjlanned program is being implemented according to the agreements. 




ft: s 



PROCESS: Cormioiication and Collaboration 



QUESTIONS 

11. Are all parties aware 
of the extent to which the 
program is being im- 
plemented? 



MATERIALS NEEDED 

Purpose of periodic 
review meeting. 



ACTION REQUIRED 



Staffing Request 
Form. 0 



Hold 'periodic* review 
meetings with team. 

Reconcile any differences 
between^^rogram as planned 
and- imp lamented. ^ 

Complete Parts Two and Three 
of ^ Case Report Surpmary Ten. 

CD 



Purpose of Periodic Review ^ 



ERIC 



The primary mechanism for evaluating program 
operationalization is the periodic review. Periodic 
reviews are held throughout the student's program 
and should be established on a regular schedule. During implementation evaluation their focus 
should be on the agreements that were established In the orginal plan. 

The implementation evaluation should occur from 1-2 weeks after the initiation of the program. 
The purpose of this first review meeting is to determine whether the plan is becoming operational 
(rather than effectively solving the problems); progress evaluation data need not be obtained. 
At this point, it is more important to know whether the data on performance are being collected 
rather than whether the data indicate the achievement of intermediate and long-term objectives. 
Subsequent review meetings focus not only on whether a plan is being implemented but, also, on 
whether data show any program effects (usually, changes in student, performa'hce) . These reviews 
should be conducted as part of the periodic review of program plans conducted by the student sup- 
port team and are discussed in Part V on progress evaluation. 

Discrepancies between this plan and the actual operations of the program are discusssed by 
the team. Some discrepancies usually are resolved during the review; other*= '^re referred back to 
the program selection group or the SERT for resolution. All discrepancies between the planned and 
operational program are recorded on Case Report . Summary Tc^n and filed for future reference. These 
records docum^ the success of a program or provide the basis for the adoption of an alternative 
program when, a result of periodic review, it becomes evident that the program plans have 
built-in prob chat interfere with implementation. 

' t EXAMPLE y 

'At the team meeting at which Ricky's program was reviewed there was general '^g.-peement that the 
program was being implemented as planned. This information is summarized in Case Report Summary 
Ten. 

■ ' 175 ■ ■ ' 
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Ikxamplk I 

The SERT included Ricky'i> name for periodic review on the staffing form routinely circulated 

ft 

to all team members 3-5 days prior to the staffing meeting. A sample of t!iis form, which should 

be used ^or all staffings, follows: 



^2^ Staffing Request Perm 



To: Members of Student Support Team 

From: SST Chairman^ • Date 



Ocjbifii/t^ V, /97S 



Here is a list of the students for whom requests have been received since ou^ 
last meeting. 



Please list students whose programs should be reviewed. 

Implementation tvaluation Progress Evaluation Program Certification 



The SST will convene in the resource room at 7 on 

. Return this form to the SERT prior to 

the meeting. 



. / 



'we recommend that the SERT chair this team. 

ERIC ITb 
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CASE REPORT SUMMARY TEN 

Results of thrc SERT's prooran. review are summarized here and circulated to 
all interested parties. 



7^ I 



Age 



, Student Grade 

III. PROGRAM OPERATIONAL I ZAT> ON 

9 . Is program being implemented? . 

10. Is program being implemented as^^proposed? 

1 1 . Are all parties aware of the extent to which the program is being 
implemented as planned? 

Summarize data from graphs here. 



Teacher 



Date yO/e /^S' 


Number of Gr^i'phs 1 2 3 




Data Plotted? ^ES/) 


NO 


Changes Made? QES/^ 


NO 


Are changes (^ES/) 
frequent enough? ' - 


NO Convnen t 



Summarize review meetin g here. 



Date 



/O/9/7S 



List chonges required to reduce discrepancy between program plan and program implementation 



Date 



1 ; / 



Rof erences'^* . : i ^ ... 

Bohannon, R, Direct and daily measurement pi*otedures in the identification and 
treatment of reading biJhaviors of children in . especial education. Unpublished 
doctoral dissertation, University of Washingt;on, Seattle* 1975* 

Liberty, K. Dilt?^f decision rules. Unpublished working paper i?20. Regional 
Resource Ccitt-^r, University of Oregont • Eugene, 1972,, * 



Starlin, A Sharing a message about curriculum witli my teacher fj* lends. In J. B, 
^ Jordan et al, (Eds.)> Let's tt*y doing ccmctking else kind of thing^ Arlington 
Va.: Council for Exceptional Children, 1972,. 
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PART V 



""Developing SMlis iiXnBPM: 
Interpretation, Refinement, artel AdjiiS^ment 

It is not so much a skill as a personal characteri st i,c--an attitude. » 
And that attitude is. one of optimism. I f '^you believe the principles 
of the behavioral approach, then an optimistic^approach rs the 
only one with'which you can function. You believe that this child. can . 
learn and that you can arrange the enyirbnment to help him iearn. You 
cgnnot, indulge yourself in the luxury of saying, *'He's tpo stupid," 
or "He must Be brain damaged." ^ " , • . 

You naturally embrace an attitude of let's try'dofng 
something else kind of thing. " ° 

Sidf^ey W. Bi|oil 

_ ( Let' s Try Doing 

Something Etse " 
. • J<ind of Thing," 

-. p- II). . 



/ » 
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Overview 

There ^re described in Part V th^ essential skills of the data-based approach whi<^ lead to 
cumulative improvement in programs. ^ ^ - ^ . 

As we'have stated repeatedly, no one can predict with certainty the specific program changes 
that will eliminate an academic or social discrepancy; such changes can be identified only through 
the systematic testing of alternatives, in contrast to teaching as it is ordinari1y\conducted, 
DBPM is a continuous evaluation design in which programs are deliberately changed and the effects 
•of each change are compared with the effects of previo'js program changes. Such comparisons 
enable pbjecti ve decisions to be made about which 'change(s) is(arej leading most rapidly to ^ 
prpblem solution and which is (are) least helpful. When program's incorporate the data*-based pro- 
cedures outlined here, they have an evolutionary quality, that is, sjuccessful changes survjve and 
become a part of the program while unsuccessful changes fall out. The net result of such an 
approach is the construction of a program that is cumulative, in its effect on problem resolution. , 
Let us revjew th.e procedures that produce these cumulative benefits: - ^ 

1. ^ iXuring proDiem selection, conduct aa ini|;^ial assessment of performance discrepancies to 
clarify what problems exist and to a'id in determining priorities among problems. The data c^oT^T^ 
lectid during initial assessment should establish a baseline agains^t wh?ch subsequent program 
modifications can be tested. Continuity in programing is established as the data collected in- 
itially are the same .data that are used in later program evaluation decisions. 

2. During program planning, carefully develop a plan containing several alternative prograr| 
changes that may lead to problem solution. Attempt to predict the relative cost and effects of 
different al |;ernat i ves, and develop the attitude thar what we^try first may work, but if it does . 

/^^not^'W-frsrve other solutions to test. " * 

3* During program implementation undertake implementation evaluation to insure that the 

program which was selected is actually in operation. Improvement of the program wi T. require a 

. - i» 

y da ^a-ba5ed_dec i s i on about the extent to which the progratn edification has had good effects on 
\ the performance discrepancies. For that reason, care must bt taken to insure that the time series 
clata collected during initial assessment are also recorded .and graphed v;hen the program plan is 
implemented. o 

I k. Change , some aspect of the program after i5 data points have be^n plotted or 3 weeks, 
/whichever comes. first, or after 3 successive points have been plotted below the estimated progress/ 
performance I #ne^. 

Progress evaluation adds two additional steps to the. process: 

5. After a maximum of three changes have been made, compare the data obtained prior to each 
program. chcinc,e with the dala obtained after each program change to determine v^fhether a c4ear 

^ohange in level or direction has resulted. 

6. Maintain those changes which have resulted in program improvement and drop those which% 
'h&^€ not led to improvement. " . ^ " 

Adherence to this routine leadb to continuous program improvement, and thte improvement is 
reflected in the graphed dafra. We cannot guarantoee that e^ch prograifl change will be successful) 
but w4 can guarantee that you will know when a change produces demonstrable success. Further, " 
we carl say with some assurance that, in the long run, you will be mor^ successful in solving the 
problems for Which you are i*esponsible than you v/ould be if yoc did not use the procedures out- 
lifted. In Chapter IX, these procedures are described in some detail. , 

■ ■, . ■ ■ 160 . . ■ . ■ . ' ■ . ; 
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Chapter IX 

USING DATA TO MAKE PROGRAM IMPROVEMENTS 



DECISION ARSA: 
P2*ogpam Adjuspnent 



FROGRAM FlfASE: 
Progress Evaluation 



CO T<i 
CO 

g CO 

II 



F'ROCESS: Measurement 



Contents 

Measurement 

Eva 1 uat Ion 

1. Achieving Behavior 
Goals 

^2. Implementing New 
Program Plans 

Communication and 
Col laboration 



1 



1 Ci ft, 



QUESTIONS 

13. What** information is 
available on cumulative - 
progress/ performance 
to date?. 



MATERIALS NEEDED 



ACTION REQUIRED 



Guidel ines for 
change data. 



bta ining 



obtai 



What \ s median level 
of progress/performance 
for each program change? 



Proceduresto compute 
medians. ^1 ; 



Compute medians for each 
program change. 



What is the discrepancy 
for each .program change? 



Procedures to compute 
discrepancy ratips. Qj 



Compute discrepancy 
•ratios. (T) 



What is the change in the 
discrepancy ratio- from ^ 
initial assessment? 



Procedures to copipute 
change in di scre^ancy 
ratios. ' 



Compute change in dis- 
crepancy ratios. 



What is the direct ion 
(tren^l) of the data 
for each program ) 
change?. 



Procedures to draw trend Draw trend lines.- 

of data for each 
change. - | 



What variability is there 
in performance for each 
change? ^ 

Is there a step 
(up or down) at the 
point of change? 



Procedures to delterVnine 
variabi 1 i tvand step 
changes, (b^ I 



Summarize variability 
and ste'^hange 
data. (Sj^ 

Complete Part One of Case 
Report Summary Eleven. 
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In describing d<3C<i-based 
decision makirg during prugram 
opennt lunali?,at ion', wf recomraend- 
ed that plnnncri prt>gram i hangcb 
be made (a) whenever the student's behavior felj below the estimated progress/pei formaui c liiK- 
for 3 successive data points and (b) after 3 weeks or 15 data paints, depending on which comes 
first. This decision rule is a useful one to follow to determine when a program change is in ^ 
•.order. 

Another useful rule is to ma' d a careful analysis of the effects ol the < luingt b thv pioh- 
lems that led to the initial referral after a maximum of every three program changt;i>. At regular 
inC^vals, these analyses are communicated to the team during the periodic reviews. The f*.ilow- 
ing. stt^^ should be followed in tlve analysis. 

LsTEPM I Determine the general level Onedian) of the heha-^nov duriyip ca^n : r ..'/u/'- 
change. 

LSTEP 2 1 ^riipute the discrepancy }}atio for each change. . , 

1 STEP 3 I CompaHthe discj^epancy ratio for the last recorded ahan^jp v:'''h ' 

discrepancy^ during initial assessment and compute *^he c-hjiH.j{* {k *hc ^ 

discrepancy r^z^os. ^) 
iSTEP 4 1 DroD a trend line^^ show the direction of the brhzincr 'or r\2Ji ^hvijr 

and compute its value. 
I STEP 5 1 Determine whether the dir^tion of this eha>hie ((^ Jeadina to u r* Vi-^ichi 

in the discrepancy.^ ^) ^ 
i STEP 6 I '^Estimate changes in variability ar>i^stepy that is, '*)hi thcr fhr}\ iii r.K 

{mediate change in the lev&l of the performance /programs dat i after a 

pf*ogram change. 

The procedures for obtaining the information specified in steps 1-6 are as ft)lluws: 



^2^ Procedures to Compute Change in 
General Level (Medians) 



The procedures fo^ identifying mediani> are 
detailed in Chapter III. When tlio data pomLSt, 
for each program cliange are ordered from low to 
high, the middle number is the median; if the 
number of points is even, the number half-way between the two middle points is the median. 

I example! 

The SERT computed the medians for the djata collected in Ricky's program and marked them on 
the graphs. (See Graphs 12d-l, I5c, and 19c: see pp. 157--158.) 

To compute the discrepancy ratio, 



Procedures to Compute Discrepancy. Ratios 



as described in.Cliapter III, determine 
desired p,rogress/performance level 
and actual progress/performance level,, 
and divide the larger number by the smaller number. Enter the data on the Discrepancy Ratio ^ 
Worksheet. " 



The SERT computed discrepancy ratios for Ricky and summarized them on the Discrepancy Ratio 



..Procedures to'Compute Change in 
Discrepancy Over Iniiial Assessment ^ 



The data-based approach affords the 3 
opportunity to objectively describe the 
degree to which a problem has been solved 
by a particular program change. Suppo *e 
we wantec* to compare the effects of three different program changes in whic^h the desirecf perform- 
ance objective is as follows: 

When presented vji t h the 80 vocabulary words from LeveL6, the student will identify 95% of 
the words correctly , ^ 

Suppose the data in Table IX-1 appeared on the Discrepancy Ratio Worksheet. The table 
summarizes the discrepancy after each phase of program modification and the degree of ^ improvement 
from the beginning (initial assessment) to the last program modification (Change 3). The general 
level.ofperformar.ee during eacb program modification is presented (i.e., the mediant of atiffual 
performance level), and the degree to which actual performance differs from desired perf-ormance 
^(discrepancy ratio) is» summarized for each change across the bottom. The Discrepancy is quanti- 
fied by dividing the larger number (desired performance level — 95%) by the smaller number (medians 
of actual performance levels) and the result is expressed in terms of "times" by adding the 
multiple (1.20X, l.OIX, etc.). The desired performance during initial assessment was 2. AX greater 
than the actual performance. After the first program modification (Change 1), the discrepancy 
decr^aased to 1.2X, and during the last program mc-if icatiaj) the discrepancy was reduced to a 
difference of IX (i.e., no difference at all). 

, What is new here is that the uable also includes a summary of the degree to which the dis- 
crepancy was changed from initial assessment to Change 3» To determine the change in discrepancy 

from initial ^assessment to the end^of (or at any point in) the program, one simply divides the 

♦ 

larger discrepancy by the smaller and indicates whether the discrepancy is larger or smaller ir^n 
it was initially. The general formula is as follows: 

lZlTe/Ts7rcp7n% = ''^^^^ assessment _(X) 

This same fur:^uJa is applied whenever any discrepancy is computed and> may be used, therefore, 
to summarize discrepancies for either rate of progress or performance. " 



Procedures to Compute Change in Direction (Trend), ^) 



A. Drawing Trend Lines. 

LgTEP 1\ Split the data for each program change phase in half. 
I STEP 2I Find the median data points for each ha'' \ ^ 





. Table IX-1 




\ 




■J' : 


Discrepancy Ratio Data for a 
Program Olvjective 
« 


0' 




I- 


Initial Assessment Change 1 


Change 2 


Change 3 


Change from 
Initial Asses. 


/ DesiYe^ Level 


35% 35% 


^S% / 


35% 


XI .0 no change 


/ Actual Le>eJ 


i^0% 73% 


3k% V 


35% 


X2. 4 increase 


Discrepancy RaYlo 


2.^0X I.2OX 

6 


l.OIX 


1 .OOX 


X2.4 smal ler 
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Plot the median data points for each half on the lines that represent 
the middle day for each half (two points will be plotted on two - 
different lines)*, 

1 STEP 4i Connect the median data points with a straight line and extend the 

line t(^ the beginning and end of the phase per*iod. 
Computing the- Value of Trend Lines. 

i STEP l| Note the point at which the trend line crosses two successive 

Monday lines (extend lines if necessary) 
i STEP 2 \ Determine the level (frequency) of the behavior on those days. 
I STEP 3 I If you are using equal interval graph paper, subtract the smaller 

level (number) from the larger and give the result a (+) if trend 

is increasing or q (-Y if it is decreasi ng. 

I EXAMPLE ( . > 

The SERT drew trend lines for all the graphs, except the yearly progress graph, maintained 
for Ricky. (-Short-term trends tend to be meaningless on yearly progress graphs.) Th,e directions of 
the tren'J lines .are summarized in Case Report Summary Eleven. 

Variability and iin.iiediate change in 



Procedures to Determine Variability; 
Immediate Change in Level (Step) 
at tlfe Point of. Intervention 



level (step up .or down) at the point of 
program change are determined by "eye- 
balling" the data. A change in which 



data points are scattered throughout the period of intervention indicates variable performance, 
A large change in level between the last recorded data point of one phase and the first data point 
of nhe next phase indicates a step ,up or down) at the point of- intervention- 

Hvaluat ion ' 

P ROCESS : Evaluation ^ 

ACTION REQUIRED 



e CO 



W CO 
Or, rr 

fx, 



QUESTIONS 

i^. Is the program as 
implemented producing 
cumulative benefits for 
the student? 



MATERIALS NEEDED 



Are there positive data 
trends? 



Are there positive changes 
in discrepancy ratios over 
initial assessment? 

Were some program changes 
more effective than other's? 



Practice in interpreting 
graphed data. (J) 



Evaluate summarized 
program change data 
on discrepancy ratio 
worksheet and graphs., 
Complete Part Two 
of Case Report Summary 
Eleven. (\\ 



Will programs for other 
behaviors identified as 
high priority during 
initial assessment be 
implemented at this time? 



Develop objectives and 
graphs for each new 
behavior. Select pro- 
gram changes for each 
objective. Draw project- 
ed progress/perf<^rmance ' 
estimates on graphs. 
Circulate form to receive 
feedback^. (See Chapter 
y] l J _ _ 
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Practice in interpreting Graphed Data ^ 



In Figure IX-1, 10 graphs are 
presented, . each different in some im- 
portant way. Each graph is "set up so 
that "(a) the vertical axis represents 

the level of behavior, (b) the horizor.lal axis represents time (days, weeks, months), (c) the 
numbers represent the general level or central tendency (niedian) of the behavior before and after 
the program change (e.g., in graph a, the general level prior to change was 25 behaviors per day; 
after the change, the general level was 75 behaviors per day) y and (d) a vertical line represent- 
. ing the point at which the program change occurred. i 

The basic question to be answered in each graph is, "'Did the changa in program influence the 
behavior?" To answer the question, we must determine whether student behavior after the program 
change- displays any of the following differences; 

Change in General Level : Is the ge.teral (meuian) level of behavior different after the 
change from what it was before the change? (Graphs a, b, f, h, i, and maybe j.) 

'2. Change in Direction : Do^s the trend of the behavior iSefore the change differ from the 
treird after the change? For example, if the behavior was increasing prior to the change, did the 
rate of increase change or remain the same? (Graphs c, d, and maybe g, h, i, and j. Graph a 
is a change in level, not direction.) ^ 

3. Immediate changes in level of behavior at point of program change ("steps") ; Is the 
level of the behavior immcniiatcly after the change in program clearly different fro^ the level of 
the behavior immediately before the program change? (Graphs a, c, d, and g.) 

^* Change in variability : Is there more daily up and d9wn movement (variation) in the 
behavior before or after thc^hange in program? (Graph e.) 

Interpreting the beha^ip^al effects of a change in program requires examination of graphed ^ 
data in terms of the four possible kinds of changes (i.e.,. general level, direction, I mediate 
changes in level, and variability) before drawing a conclusion . In the graphs presented in Figure 
IX-i, we feel most comfort^ible in concluding that a lasting change is reflected in castis a, c-. 
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O Fig. IX-'I. Ten graphs depicting data collected before and after a program change. 



d» and e; temporary change in g; and no change in b and f . We are uncertain about*^ whe their chang- 
ing the program produced behavior changes in cases h, i, and j^T^ • . 

Learning to interpret graphs is like learning any new concept. You must repeatedJy practice 
on luany variations with some assistance and feedback until you become -.prof icient , One thing 
is sure, correct interpretation requires the examination of each graph in therms of all the dif- 
ferent kinds of changes th«'it can occgr^ not one alone.^ .Graphs b and kf, for example, clearly 
illustrate the hazards of using cluihge in general level without regard for tl\e direction (trend) ^ 
of the pre and post data. The general levels of performanoe Sefbre and after the prqgtam ch(inge 
clearly differ, in both cases^ and when direction as welL as devel is considered it cis evident 
that the program change had no effect at all on ' performance^ The val.ue of time ^series data is that 
they allow us to consider direetion^'as well as levei. Pre- and posttesting (e»g., looking at tVib 
behavior on tlie first and last days only) permit us to consider change in level but .not direction,-, 
variability,- or step. • r ■• \ /" V 

i EXAMPLE I ., ' , ' " 

The following graphs, .12e^, 12e-I, I5d, and 19d show data plotted by the SERT for Ricky during 

the. first three changes of each program, modification j[reading prOg^jeS;S, math facts,' noise)* Note 

that the level of the dat*a*is shown on tiie graplis for each program modifica- ' 

tion. Levels arc presented in t.he.tear drop^ and direction j.s shown as a straight line ^running , 

in the direction of the data. In addition*, noi^t; that each time a new cliahge was igipleittented,, a 

• > , s - 

vertical line was drawn halfway between theJ^nes on which the data point for the last change was 

plotted and the first dara pcJint for .the nejtt change v^as plotted. Irf the margin above the 

■'^ , " * # 

change a note was made identifying* the modif icaXion^s) in Ricky's pugram that occurred at that, 

point. ' ^ - * *' V ' / 

Let us look at each cf Ricky's graphs. First inspjact Ricky^s math computation 'graph (15d). 

As you can see his level of pevforr.ance was 10 correct and 1 incorrect per minute during initial 

assessment, and the direction of his per formance. was unchangipgJ The first modification in, his 

math |.rogram consisted of daily flashcard pravtic(r*on facts with the 3ERT. Was tlUs modification 

a program improvement? Ricky's correct rate increased from 10»to^L4 per minute, but his. error* rate 

also increased. His accuracy actually, decreased! Daily flasbcard practice resulted in Ricky's * 

doing problems faster but less accurately. Ft^jther, all the performance change occurred in the 

first t'^c uiys of flashcard practice; after 12 djys he w^^ performing virtually the same as at 

the beginning of flashcard practice*!, , ^ ^^ ' » 

At this point, t|ie SERT. modified Rickv's program aga-ln^'^y introducing 10 minutes of writtep 

practice on a math facts work sheet. Was the written practice modification a program improvement?. 

% , , • . * 

Clearly, it was. Ricky s level moved. to 22 correct and 2 incorrect prQblems per minute..^ In 

addition, his performance impr>e)ved steadily for the first five days and then began to level off. ' 

The wjritten practice modification produced an increase in speed, accuracy^ and ^direction. Because 

Ricky's improvement began to level off and 15 data points had been recorded, cVen thu^jgh Ricky 

had achieved desired performance level the SERT implemented a point system to rsinjtor*-^^^cky for 

further improvement. Was the point system an improvement? Ue would say no because the direction 

of^'the data remained the same; bjt even more important, errar rate increased to 6 per minute or 

'3X greater than during the practice phase, ^iice three changes had been made, the SERT com[^ut.ed 

the discrepancy ratio change. The actual performance level lor correct facts/minute had changed 

£rom 10/min. to 22/min. , a 2*2X change! The errox, r^te had increased from 1/min. to 6/min. or 
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Graph 12e. Ricky's monthly progress in Read Series after -three program changes 
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Successive Calendar Days 
Graph 15d. Ricky* s performance on math facts, initial assessment and three program changes. 
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a 6X increase! Since Ricky was now writing answers to math facts at a rate which was faster »han^ 
the desired level, the SERT decided to reassess peer performance on this task. A random samp-l:e= 



of average students was asked to write answers to math' facts. Their median rate was now 30/.mln. 

* with 1 error. Recomputing ttie discrepancy it was evident that Ricky was still l.AX slower than 
\ his peers. In addition his error rate v;is 6X greater. What would you do if you were Ricky's 

SERT?- . 

Shift your attention now to Ricky's daily progress reading gmph '(12e-l). This graph depicts 
P.icky's daily progress througli the Read Series. Because it is a cumulative graph the direction 
of the^ data will always be upward osr level (no piogress) rather than downward. Averages on this 
graph represent the number of page.b mastered per day during the program ch<inge. The SERT has also 
drawn a projected progress line on the graph (ihe dashed diagonal line). That line is the rate 
of mastery whii h she would like Ricky to attain throughout program modification. The shorter un- 
broken lines running through th^ data points for each change represent the direction (.rend) of 
Ricky's peefornuince during the modifications. To u3e direction as an item of information for 
program improvement on a cumulative i,r.*ph, you must compare the slopes of the trend lines for 

* steepness. 

. . . .* ■ ' ^ 

Which of x.\\st modif icationb in Rick> * s reading program weic* improvements? Introducing daily 

oral reading practice (the first modification) appjears to have been an improvement; however, tlie 

eight jdays of data are insufficient to safely make this judgment. The thr^e data points below the 

estimated line have resulted iu a decrease in the diiection of the data points. Introducing 

0 points for improvement (thf scuSnd modifii ation), resulted in a decrease in Ricky's average level of 

mastery over the first modification. The third modification, in which Ricky set his own goals, 

clearly affected Ricky's performance. There is a large increase in level of performance as well 

as in direction! Involving Ricky in making deci^sions about his own program resulted in large 

gains. Clearly, this change should be retained. The discrepancy is l.AX smaller than during 

initial assessment! 

c 

In Graph 19d; noise made by Ricky and his peers, we can see that during initial assessment 
Ricky was more than 15X noisier than the peers. During the first change the discrepancy had 
decreased to 5X, but thv tren.d of the data increased (undesirable in this case). During change two 
the data points for both RicJ^y and peers are below the estimated line. The trend of the data is 
decreasing which, in thi.8 c.*^»c, is exai^tly what is desired! Change three produced the same re- 
sults. What decision should be made regarding the effectiveness of the program changes? Is it 
'clear which change had the (> *t..test effect on the behavior? In this case, the. positive gains 
appear to be based on the cumulative effect of all the changes. Does the program need to be 
continued? This is a decision the SERT v^ill have to make. "Perhaps other aspects of social behav- 
ior should be reevaluated and \ew progr^im modifications developed? What action would you take? 

The important point is that program improvement results from this ..type of progress evaluation. 
Each time a maximum of three changes are made in any program, the g£aphed ..ata are evaluated in 
•thisway. Program decisions result from this analysis. 

Whenever a pupil's behavior 
is being modified to the sa'^^ 



isfaction of the teacher, SERT, 
and other team^ members, the t l»*ie 



Doveioping Additional Objectives, Graph?, ft) 
Changes: Proprcss/Per formancc Estimates 
for New Programs 



has come to think of changing other behaviors. Here are some guidelines which may be helpful in 
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deciding whethpr new progriims should be implemented: 

1. Persons rcsptjnsible for Ricky's education express new concern about specific behaviors 
whioh were identified during initial assessment. 

2. The discrepancies far the- present prograin(s) have been completely reduced. Hence, the 
prbgram(s) can be terminated* which makes time available to begin a new program. 

3.. The trend of the data for the present program(s) is increasing and there is a strong 
indication that the program(s) will be termin.ited soon. If time cQn be made avail^able, ^mother 
program can be started. 



The first new program, progress in the matn skill sequence, was implemented for Ricky on 
December 8 . Recall that wh^n the SERT reviewed Ricky's program for computing math facts on Novem-, 
ber 11 she found that although the discrepancy in writing answers to math facts had decreased, 
Ricky's error rate had increased 6X (fiom 1 error/min. to, 6 errors/min. ) • A change was implement- 
ed specifically to decrease error rate. After three weeks, the error rate had decreased to one 
and the trend of math facts correct was increasing again. Upon reassessment, the SERT decided to 
begin a program in mastery of ;iiath objectives (see Graphs lAc and 14c-l) . 

The following objectives jnd change procediires were wriLten on Case Report Summary Six.: 
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The following measurement procedures were specified on Case Report Summary Eight: 
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A second new program was implemented for Ricky for spelling on December 8 as well. This 
program was developed in response to Rivky's teacher's concerns regarding spelling. Reassessment 
of Ricky's spelling performance and that of average peers in his class revealed the following: 
Ricky: Median of 22 letters written 

correctly per minute in sequence. ' ^ 

o Peers: Median of 35 letters written 

t* - 

correctly per minute in^ .sequence. * , 

The new discrepancy was therefore 1.6X less, a change which was 1.2X smaller than the initial 
assessment still la. je enough to be of concernr (See Graph 16b.) 

The followfng^objectives and change procedures were written on Case Report Summary Six: 
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The following measurement^procedures were specified on Case Report Summary Eight. 
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At this time the SERT also reassessed the off-task behavior of Ricky and peers. The data col- 
lected -were as follows: ♦ 
Ricky: Median off- task behavior/minute .3* 
Peers: Median off- task behavior/minute .4 
The new discrepancy was therefore 1.3X less off- task behavior for Ricky than for peers. The 
discrepancy no longer existsed. When actual level is greater than (or less th^n for a decreasing 
behavior) desired level .the discrepancy is treated as. l.OX (no discrepancy) when computing change 
from initial assessment. (See Graph 18b. * * * , 
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Graph ]kc. Ricky's moilthly progress graph, math sequence, showipg initial assessmefit ^ 
re'assessment data and estimated progress line for interventiqn.. 
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*^ Included hej^e are the monthly progress data for reading^ 
^medians for^ each program change for the math facts , and noise 

programs aij|d the reassessment data for progress in the math. 

sequence, spelling and off-task behavior. 



J5 



179 



CO 

51 



1 



1 



Communication and Collaboration 

PHOCESS: Commwxiadtion and Col Icibomtion^. 



QUESTIONS 

15. Can information 
gathered on program- 
changes be u^e^ful'to 
others? ^ 



MATERIALS NEEDED . 

Purpose of periodi^ 
review meetings. Q 



ACTION REQUIRED 



Are all interested parties 
informed of progress? 

Are there recommendations 
for program adjustments? - 



Staff ing^equest 
Form. 



rrinoRc 
n. (2) 



Hold periodic review 
meet ing wi th tedjn, 
^parent, sjudent-; 

Sfi^re data on student 
progress/performance 
with te^m, parent, 
student. Discuss recbm^ 
mendations for further 
program improvement. 
Complete Case Report Sum- 
mary Eleven.' (z^ 

Continue program as 
recommended. Repeat review 
process at regula( Inter- 
vals. 



Program improvement is based on data 
evaluation made by the SERT after each 
of threye program changes. At regular 
intervals, the results of the evaluations 




d^f^Li'ibutl in the previous section are shared w?!th team members, parents, a^nd the student. This 



communication with the persons who are concerned provides feedback on^those aspect^ of the program 
which are successful and L^hose changes which /have not led to program improvement.^ When shared, 
the information frequently results in th^ ad/aptation of the successful tihanges tOy behaviors which 
are not part of the initial program modification plan. In addition, the review provides the 
opportunity for program accountability. / . - / 
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Prior to- the periodic review, the SEI^T reviews the data which have been colAected and summar- 
izes data on general trends,/ levels, and variability for all program changes. yJn addition, the 
most effective changes are identified.^ Recommendations fo^: program adjustmentit that need team 
approval are also summarized. If new program modifications are recommended, dtjectives, change 
plans, and graphs are also/completed as'tliey were previously (see section on/,evaluation) . 

/ I EXAMPLE I ' I 

The SERT summarized yhe relevant d^ta for Ricky on Case Report Summary pleven for the 
time period September 27, j 1975 (impl i^meintation of the program) to January 1'5, 1976 (periodic 
review), based on data shown in Graphs i2f, 14d, 14d-l, 12f-l, l5e, 19e, and 16c (.see .pp. 181-85). 
At this time 5 changes had been made in Ricky* $ reading program, one changf had been implemented in 
the speliing program an^ no change had been made in the math skills program. The change which 
was Implemented In the inath facts program related to instruction in the m^th skill sequence. 

In social behavio|, the program to reduce noise in the classroom had also been completed 
satisfactorily. The SERT had reassessed Rjcky^s off-task behavior and found that the discrepancy * 
was now completely rejUuced, Ricky was 1.3X less off task than his peers! 
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Data on these programs were summarixe^^v tlit piscrepan^y Ratio Worksheet and Case Report 
SummarY Eleven and subsequently reported .to the ^eam, Ricky, a,nd his parents. 

At subsequent review's, the same proc/sdures will be falJowed. This means that for each stu- 
dent, several copies o£ Case Report Sumnulry .Eloven may be filed during any school year. 

' ^"^'^"^ . / . I EXAMPLE. I . 

The SERT included Ricky's name fo^ periodic review on the staffing form routinely circulated 
to <U.l team members three to five da^s prior to the meeting. A sample of this> form follows. 
The results of th6 staffing are summarized in Case Report ^Summary Eleven^. 



Staffing Request Form 



This form is used to convene all staffin'gs^ 
To^f Members of Student ^uppoi't Team 
^rom: S'ST Chairman^ 



Date 



/ 
/ 



/ 



Here is a llsc of the students for whom referrals have been received since our last meeting. 



^7 cd 



Please list students v/hose programs should be reviewed. ^ 

Implementation Eva ligation Pre gross Evaluation^ 

/ 



Program Certification 



ShLLY tGradi^ s) f^icty fGtsJcj) P^ul (Grade ^) 



The SST will convene in the resource room at 



Return this form to the SERT prior to the meeting. 



/ 
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^^We recommend that tHe SERT chair this team. 
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Graph 12f,. Progress evaluation ireview: Ricky* s 'monthl y progress, Read Series. i 
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Graph I4d. Progress evaluation review: 
Ricky's monthly progress, 
math sequence. 




J TIAb/ irf School /(Weiks)l 

Graph l^d-l. ^Progress evaluation Ireview: 
Ricky's weekly progrless .on 
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SCHOOL: ^iver «f?un 



CURRICULUM: Reaa 5ene5 




kfy: 

"iif ivTated 

PR06RESS 
(CUMULATIVE) 

CHAM 66 
LIME 



TREND LIMES 
NOT 5HOWM 



'•/l '•/» '•//* i*/tx.t»fto "//» •/« '>M7 i»H 'V* itiliittt '/i 
Time In School' (Days) 



'/if '/« '/« -Yr 



Graph 12f-l. Progress eval uot ion. review; Ricky's daily progress, Read Series, showing 
three changes in the- estimated progress line. Trend lines have. not been 
drawn. The reader may practice drawing trend lines follovnng the instruc- 
tions on pp. 167-68.' Use different color ink. 
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STUDENT: RicK/j>. 



SCHOOL: Rive*' Ran 



CALENDAR WEEI^ 




CURRiCULUM: Ma^il fscis 
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Successiv,e Calendar Days 



Graph 15e. Progress ^evaluation review: Ric|<y',s daily performance, math facts, showing, second 
desired performance line, second estimated performance line, and^ trend lines.-. 
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Graph 19e. Progress evaluation review: Datg"for Ricl<y and peers' noise in classroom. 
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STUDENT: f^lCKY 



SCHOOL: f^WJER RUN 

CALENDAR; WEEKS 
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Graph 16c. Progress evaluation review: Ricky's daily performance. Spelling. 
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CASE REPORT- SUMMARY ELEVEN, 
This form is completed at progress eval uat ion period ic reviews. 



Student 



Grade' 



^ I 



Age 



Teacher 



IV. PROGRAM IMPROVEMENT ; . 

1 3 What information is available on .cumuj at ive progress/performance 
to daTa? - . 

What data are available for each program change? 

W hat is the change in the d i screpancy' rati.OA.,f rom initial assessment? 
Have programs been developed since he last peHpdic review? 

Summa.ri2e data over program changes here. List behavioi; new ^sincK last periodic review. 



Behavior iTrend 



Negat I ve 



jo^^ 



Nega-tive 



Negat ive 



Nega t i ve 



£QsitTv?> ' 



Negative . 



Level 



^ ^ricreas^^ 

Decrease 



Decrease 



Increas e 
^DecreaS? 



Decrease 



Decrease , 



Variabi 1 i tys-! 



Step at ' ' 
Intervention 



Up 
Down 
fJone^ 




Down 
None 



up 

Oown^ 
None 



Up 
Down 



Qown^ 
None 



1 4 . Is the program as implemented producing cumulative benefits for the student? 
\ Are there positive changes in the discrepancy ratio? 
We some changes moxe-<.ef feet ive than others? 



Beh"av i 



lor^ 



Chan^es^wh ich were most effective 



Cao^r^cA AJb/^ Ad/^ 



15. Can information gathered on program changes be useful to efthers? 
Are all interested parties informed of progress? 
Ar;e there recommendatio;is for future program modifications? 




Recommendations for changes. 



Review date ///^/^A* 



Present: X!k 
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I .'h'''s ■•" 



Introduction 




Certifying a program to be satisfactorily completed, like the Identification ofi important / 



^ , . , _ ^.ricat^ion or^ 

problems, involves both ^object i ve and subjective judgments. In .Part VI, both dimensions of pro'grahi 



certification are di 



i scu^ 



sed in detail . 



/; 



Jwo types of objective data can ^be obtained from the graphed record , of a child's performance » 
which indicate that d^/^(>rogram is successful: ^ ^ ^ / ^ 

^ Data showing, that tSe prpgress/performancg^fscrepanc^y has beea ;complete^y' reduced ^ 
(actual performance a nJ desired pet rut^na ricg^lTnes are identical). ' ' ^ 



2.,^^0ata showij^^ that the program' as currently implemented will result in ^^complete reduc- 



tion in the discrecfancy by the end of the school year (indicated by a trend- in ^the data that, 
Jf projected, woultf ^'coincide with/ the desired performance line).. . < . . , / 

Although objective data are central to D8PM, s,ubject i vi ty is always a par^^pf decision / 
making. Because subject M ty has a s i gni f lean t' inf i uence in decision making,, we believe that it 
sKpuld be .contro/leJ ^ much as possible. In D8PM, the control is exercised /by^ maXl ng subjecti/v- 
ity explicit ratiher than Implicllt ^nd embedding the values that influence program certification 
decisions in a/systematid framework. lo'Chapter X, both dimensions o£ prbgram certification 

are^discussed. J *'* ^ - ** / . ^ - 

/ ' - ' / f ' I 

Al though brogram certif icatipn includes many of the elements of program adjustment, it / 

differs in iti purposes and results. In program adjustment, decisions aljways focus on whether ' 

specific pro^/ram changed are bel^ping to reduce specif Ic discrepancies, /n program certification, 

the decisions always fbcus on whether the tolal special /education intervention has been success- 

ful. Thus, a program adjustment decisi.qn addresses the^ question, "Has,^ for example, phonics 

instructiof^' improved the student's word_ recogni tjon skill?" For program certif ication, the 

question wo^uld be, **Has special education Intervention eliminated the /disc repanc ies that were the 

basis for t^he initial referral?" * / - 



In 'the jargon typically used by educational evalitators, program ad jus tment decisions are 
tive while program certification de?:IsIof.s are summative in nature. For a further discu 



^he 



format 



scuss ion 



of the djstlnct*on betv;een formative and sumr.atlve evaluations, see Scarvia, Anderson, Murphy^ and 
associat4s (1975). 



Reference 



starvia, B . , Anderson, S. B. , Hurphy, R. T. &, Associates . The encyalopedia ; 
j of edwyaHoK:,'^. evaluation: t''onr*epia and te^^hniques foP evaluating edumtion 
1 1 and training pror^rairs. San Francisco: Jossey Bass, 1975. 
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DECISION ABEA: 



Frogram CeH'ificaHon 



I 

I 



V- ■ 



' tChapfcr.X 

/ PROGi^AM cert/if I CAT I ON IN^ DBPM: 
OBJE,CT/IVH AND SUBJECTWE EVALUATIONS 



Overview 



/ / 

/ 



/ / 



/ 1 



mOGRAM PHASE 
iputcome Evaluation 



Overview 
Measurement 
Eval uat ion 



/ 



Communication and 
Col labora^t ion 



The basic idea of r^WM is that individual pr^o^ram mod if i 
cations should be devis.^d when discrepancies in *7<^ademic ^tid 
social development are identified by people who. occupy, a, 
significant place in^ tl^e lives of students., Datarba^ed ^ro- . 
gram modifications Require that (a) the identified di^crepan- / 
cies be measured ana (jb) the effects the i)rc/gram modifica- 
tions in reducing those discrepancies be^ continuali>^ n^onitored.. 

When perfortnaiice discrepancies have been redu<-ed ^o/t^at they no lojiger are considered important, 
the point has beeti reached when program modification, can. be certif-6d as complete oi successful 

The procedu^e^ for summarizing the effects p:^ the program modafica tions are presented in 
Chapter IX iinder "pi/ogress evaluation" (pp. 164 , ejt ^seq. ) . Whenever the median level, oL actual 

' ^ U : • . ■ c . V/- -- - - - 

.t-_ J J '•- -el 




// 



Contents 



Final Comments' on Pro- 
Zg ram, Ce r t i f i^ca t i on 



^performance reaches, the desired performance level the xiiscrepapcv between the desired and actual 



performance has be^n reduced to IX difference VV^., no differeyfce at all) apd objtjctively , then, 
the pfogtSm Ms AyGfm modified sufficiently^ to sMve t^he ,problem4^ identified daring the initial ^ 



assessment."^' • 



One imp(>rt^nt value of the .evaluatipn procedure^ present/d in this Manual is that continuity 
of data collection is preservi^d from th^ inLtjijiX as^essjnent tthrpugh program modification to (jut- 
come evaluation. Thus, the same type ,of datytr^wluch led in ylie first pl/ice to judgments^that a 
discrepancy existed ajre used to make 'Juigmejll^s about wheth(^r a program, is working and, fi .ally, 
that the ^prog^am has bpen successf uJ> Thl,i>^contih,uity contrasts sharply with ^>stems for modif>jing, 
programs'^ that ,t^ly on measurements oj^ performance which ^ ate unrela^ted t<j actual classroom perform-: 



ance (e.g., individual standardized tests; and are usuaHy, obtained only at /the beginning and end 

f J ! . ' . i ' ■ .11 I - 1 

or a_ program. . j J 



V 



ERIC 



In raan^^ school systems, it is , not^^nconimon for a c|illd*s eligibility fqr special education 
services to .be determined by a school/ psychologist or ot/ier professional who works outside of 
the classroom setting and base^ eligibility judgments op standardised intelligence or personality 
tests. If the child i^ declared, eligihle for the special services, he must be "reassessed" by 
si)ecial edlicators; since they must det^eriAine the kind, of intervention to , organize for the child, 
they may use some kind of standardised achievement test as the ^asis for their .judgments.- During 
the inteyvention period, the special educator collecjis the ^'^yailablc data on the ^hild*s performance 
which Is^generafed by classroom ex:ercises artd the teacher 's j'udgmtnt . , And another standardized 

■// 2oy / ■■ ■ ■ ■ 



/ 



>3 f 



achievement teet may be used to measure the child's achievement, upon program completion. Eac/h 
;3et pf test results used to assess the child's performance is a discrete unit that hat, nothing 
to do with preceding or suci:eeding lest results. In fact, /what 'is being measured 
ences in the child s performance but differences in the vatious test tasks. 

^ . Examples of Type of Data (/oil ec ted 



is not dii^fer- 



Decision 
Eligibility 



\ 



Traditionally 
Wise IQ / 
k-Stanford /Achievement 
V-Californaa Test of 



\ 



Personality 



DBPM 

Discx'epancies on mainstream 
, curriculum tasks: 'j' 
-oral reading . / 

-comprehension • j 

-spelJ ing / 
-math computation and concepts, etc* 
Discrepancies in classroom: 
-noise - " ' , 

-physical cpntact 

--out- olF— plac^Q • ._™w ' - 

-off- task ' - 

-social interaction, etc, . . " ^ 



/ 



Objective's of lPr9gram 

Plan */ 

/ 

/ 



-I,TPA ' . > / 
' -SRA Reading and Mdth' 
. • i -Iii|oi?mal- Reading /Inventory 



Samer* as for eli'gi'tility 



Progress /Evalua t ion 



-pe^rcentage of objectives 

mastered . . ' r . 
-tefacher estimates 
-"end of, book" /tests? 



Same as for eligibility 



Program • ef f ec t;iv eness 
.(ciertif icat^on) 



-Wide Range Achievement Test 

-behavior checklist 

-current curriculum placement- 



Samo_as for eligibility 



/ Communication problems among the various pe^-sonnel responsible for cjecision making are 
es/acerbated in the traditional tipprodc'h by the Irck of continuity and focus in data-collection 
activities. Further, the lack of comparability in tasks used to measure performance throughout 
the program modifipation makes it impossible to make valid judgments about program ef f ectlvenea^ 
'Finally, pre- and posttesting of students, even when the same instrumen.ts , are used, cannot be 
used as an evaluation design. (This issue is discussed in Ch. III.) Although the preceding 
examplfe is, admittedly, an oversimplification, it depicts the greater decree of continuity in 
the data which are used, /or decision making in DllPM, and the potential fpr clearer communijcat ion 
among all the persons who are involved in the program ipodif ication proc;ess. - ' / . 

The important point here is that the evaluation procedures in program certification are 
identical to the procedures that are used in problem selection (see Ch. VI).' Whatever data- 
collecting procedure was the basis for modifying a student's program 1^ the flrsti;place Is now 
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the. basis, for determining whether t-fie. program has been successtlil.^ In pta<^tice, the|^c'fore, 
either the decisibn matrix approach (p. 115), the collabc)rativi model (p.U?), or su|ne combination 
of both can be u^^d to help answer the questions addrehsed dur/inHj tins final phdfy DBl'M. Ihese 
procedures are discussed in the remainder of this cliapter. 

/ • . • 

FROCESS: t^Isasm^ment 



a o 

o 

p ail 

Is 

^ o 
a; o 



QUESTIONS 

17. What are present 
prog res s/performance 
discrepancies? 

What are present dis- 
crepancy ratios for all 
behavior's modified during 
the' prog ram? ^ 

WhQf IS the^ present 
trend of the data? 



MATERIALS NEEDED, 

Collecting Summary/dataj 
for the program erf i f ir 
cation decision. J\y 

y 



ACTION REQUIRED 



/ 



Summarize /data on the 
discrepancy ratio work- 
-u^^. Df-aw frend lines. / 



sheet. 



I 




/. 



Comf/lecte Part One of fase 



I Report |5ummar,y Twelve, j 



Collect Wgv^Summarv m'ta for the nj 
Program Co'/-<: i fica t |on Decision 



The questions whit-h must be answered 
affirmatively before a program tan be 
-^certified as completed are as tolio«;.s; 

1. ' Have the dXs.crepancxes be^^ween 
desired and actual ^Progress/performance been complfetely redu|-ed' (U a de^ii»lun m.urii'. Is u«t.d, 
the .wiyighted dlj>crepancy should bo substantialjiy /reduced. )_ i / 

2. If the, dLst.repJni iert have nui been comp/etoly rfdurLd. Is there y^vident^ that the din- 
.crepancies can be reduced wlthirt* a ,rea£ionable tyme period* vithuut turth* r Hp.ec la,! t^dtuatlon 

intervention? ' / , I ' , ' 

The data' needed to answor both ^juestlnns ire the m*»st r^i < nt tUsi ilt /»ani.v r.ii tos and iri^nd 

'J- 



data for each behavior for whii h u program uaj developed, and implement|b^t,' a^i wull a« ilata *»n all 
previous programs which wers^ developed and completed during program imp,lementati*»n. 

The procedures for computing the^e daC'Warq described ^in Part V art* not lepeatt^d lie re. 
Carrying out the procedures for Ricky pr(»vi<7es what is essentially a feview, howc\»r.' 



I exampi:e | \. J. 



The SERT drew trend lines for the Ui^t phase of 'e<ich of Rit * s^jprogramit that was scill In 
progress^ on Graphs l2g-2 and I4e-l. (Grapi.^ 12g and l/*e ar*» <ils4> fnijluded here but trend data 
are not drawn on yeaily progress graphs./ Graphw 32g-l (Dativ tteadA^g Pro^.reHs) and 16d CSpt'H- 
ing)*are included so the reader can rev^w the data collected sin^e ^Ut\ last ptii^uam r«'vlfw on 
January l(x,^ The spelling program was t^•rmlnatt^d by the SERT on Fe/brjiary 16. The dillv pr*»Kress 
graph in reading Is i)4rt of tht* ongoing frequence of dally graphs iy whin> -tliM^ro^jam was eval- 
uated after every three changes., The/ discrepancy ratio data fur^ th|:- last phase of v.uh i^ogr.im 
were enttered on the Discrepancy Ratio Worksheet (p. 20^i). 
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The discrepancy ratio data^ change over initial assessment tlata", and trend data for every 
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. 4.nipletnented program modification were then bummarized on thu first part of Case Report Summary ' 
Twelve. (Sec page 203.) 

PROCESS: Evaluation . 



o - 

• O til 
^ «^ 



QUESTIONS ^ 

18. Should the program 
pre:>ently planned and im- 
plemented be terrpinated? 

Has program been success^^ 
f'ul in reducing 'the dis-- 
crepancies? 

Can others assume res- < 
pons i bi 1 i ty Fqc this ' , 
student's program .wi tnout 
assi stance . from Special 
Education personnel? 



MATERIALS NEEDED 

Guidelines for program 
certification decision. 



sion. 

o 



ACTION REQUIRED 

Reviexv summary data. 
Summarize and mak^^ 
recommendations.. mJ 



Cdmpjete Pnrt Two of 
Cas e^ Repcr t Summa ry 
Twe 1 vfe . 



STUDENT:<^»ck:y, 



SCHOOL: River Rur\ 



CURRICULUM -Red J Scries 



i Yrs? 



:d 
-J 
:d 
g 

cc 
o 



CO 
CO 
LU 

or 
CD 

cc 

D 

c 

B 

AH 



it -5 
J -4 




A DF5IRED J-EVCL , .. ; 

• Actual . UEveu - ' 

(MOHTHLY) 
y OeSlRBD PR06RES5 ' 

^ f^06Re55 LIME * 
' e5T|MATED'>ft06RESs' • 



TIME IN SCHOOL' ( YEARS ) 
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feraph 12g. Program certification review: Ricky's monthly progress^ Read Serieibj 
data for 9-month school year.. . ^ 



CURRICULUM: Read Scffft* 
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PR06RES5 . 
(CUMULATIVE) 

MASTERED 

• LIMES' 

TREND LINES 
NOT SHCWN 



lij io tS 3* 3S. 40 IS » S5 *0 tS .70 75 tt SS % 9$ 



Tlnriel In ^ School (pays) 



Graph 12g",l. Program certification reviev/: Ricky's daily progress graph, Read Series, 
, / for period 9/27 - 2/5. Data collection ct^ntinucd on Graph 12g-2. 
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'CURRICULUM: Redd Scriek 




-4 



1 

t 

EST/MATED 

..^ CCUMULATIVE) • 



i i/ 3 /»• ae w.jB 3f ^ w »o « *« » 7f f9 cV 
; !/ J/jU Vj* 9/7 ^11 3lv 3/t$ 4/f */» ^1$ <A* «/« *yf ^'rt sr/» 5/jo */» 

• ./ Time In School (Days) 



.Graph 12g-2. Program'certif ication review: Ricky'^ daily progress graph, Read Series/, 
, - I I for period 2/k - 6/6. . ^ ' '[ 
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STUDENT; 



RicXy 



SCHOOL: Rfvc/ Ruw 



CURRICULUM: MfttV^ Se<^UC^ce 



g 

DC 

o 

Z»j-3 

coM- 

CO 



W-2 



a: 




KEY: 

tiXp^5\Ret> LEVEL 
♦ ACTUAl- UEVEL 

(MOMTHLYj 
/ oeSIREP PR06RES5 

/ NON INTERVENTION 
PR06RE56 LIHE 
ESTIMATED 



2 



4 . 5 ' '*^6 



TIME IN SCHOOL ( YEARS ) 



Graph lAe. Program certification review: JRicky*s monthly progress graph, math sequence, 
data for S-nionth school year^^ ; ; v ' 

STUDENT r'Rlck/ . < ' SCHOOL : ^iVtK Run CURR|CULUM: Md^Un Se<J,UCIlce 



3 

g 
oc 

3 
O 

:2 

CO 

^8 

OC 
(D 
O 
OC 

, a 




fST/MATE^D 

PR06RBSS 

• Actual lcvel 
(cumulative) 



NOT SWH 



TIME IN SCHOOL ^(WEEK^y . 



ERIC 



Graph lAe-1. Program certification review 
data for entire program 



iew: Ricky * s 



ky*s weekly pr^ogress graph, math sequence, 
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STUOENT:R,ck^ 

IN * 



SCHOOL rRcvcr Run 



CURRICULUM: Spcllmg 



CALENDAR WEEKS /'WWr^^?^.,.. 




MWf MWf MWf MWf MWf MWf MWf MWf MWf ^ Wf Mwf MWf MWf MWf MWf MWf M Wf MWf MWf MW^ 

Successive Calendar Days 



00 



kfif^^^ iSii'^t^Prp^^ifi^c^^^ "Ricky's daily per 



formance graph, Spelling, data for 
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STUDENT: fiScky 



SCHOOL: River Ruri 



CURR ttUCUM: H^-Ha Fa<sfe 
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.^rg-. ESriMArED 




MWf MWf ^MWF ' MWf * M Wf V Wf MWF ' MWf' MWF MWf M WF^ MWf ' /AWF MWf MWf. A\Wf MWf MWF MWf MWF 

Successive Calendar Days 

, • ■ < ■' • -. • _ 

Graph 15f' Program certification review, Ricky's performance in math facts for period 9/15-2/3. 
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0 1 „ As in the progrdm eligibility^ decision. 

Guidelines for "Making the 'Program the collaborative or decision matrix approach 

Certification Decision / ' ^/ , 

. I can be us^d to make the program certifica- 

tipn decision. If the decision matrix 
approach is used, the present discrepancy ratios are multiplied by the importance value^'of each 
behavior (determined when the eligibility decision was made) and the totals are compared to the 
origiml weighted discrepancies. In the following illustration, the same importance values are 
used as those given in the decision matrix for program eligibility.. (see Ch. VI, p. 117). 

Behavior 



rReading 

Math (Sequence) 

Noise 

Spell ing' 

Weighted 
Discrepancy 



Importa^ice 
Value ^ 


^ Present 
Discrepancy. 


_ Present 
-.Total 




Previbus Total at 
Initial Assessment 


15 • 


• 1.7X --^^ 


25.5 




67.5 


10 


L. 1)( 


11.0 / 




37-0- 


5 


1 .t)X 


5.0 7 




75.0 ■ • 


10 


1 . OX 


10.0 /• 




20.0 


^0 




i.0.0 - '-^x 




Ao.o ~ 5. OX 



-7^ 



During program certification, * tlje current weighted discrepancy is compared to the^ ^original 
weighted discrepancy by dividing the larger number by the smaller. At present, the weighted 
discrepancy is 3.8X smaller than it was initially. The' present discrepancy also can be compared, 
to the' discrepancy cut-off initially established for determining eligibility. Clearly, the 
1.3X discrepancy is considerably smaller than the 2. OX cut-off recommended ^to determine program 
eligibility. Using the decision matrix does not exclude a review of the trend data, however.- Al- 
though the over-all weighted discrepancy has been reduced, it is important to determine if all 
individual discrepancies have been completely reduced or will be reduced in a reasonable time 
period without further assistance irod special education services. 

The trend data for reading progress (ifor which a discrepancy still exists) indicates that . ^ 
progress is increasing with peer tutbring but this intervention has not completely red.uced Che 
initial discrepancy. It is quite likely, therefore, that special education intervention in 
reading will be required another year. , 

In the collaborative approach, the discrepancy and trend data also are reviewed but, as in 
the program eligibility decision, the program certification decision is based on group consensus 
rather than on precise numerical specifications. 

i EXAMPLE ^ 

At River Run S.chool, the collaborative approach.was used to make the program certification 
decision for, Ricky. The review of the summary data on Case Report Summary Twel-^e, the Discrep- 
j?ncy Ratio Worksheet, and t>I>e "trend lines on the graphs for the programs still in progress 
(readfng and math skills) ^reyealed the following: 

' The discrepancy in reading was not .c^ompletely reduced. The trend of the data, however. 
Indicated increasing progress. In math skills, the discrepancy was almost completely reduced and 
no further intervention appeared to be necessary. 



/ 



.This behavior wa^ not, included in the matrix on p\*117. 

, ■ ^ - 2 
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All th^ program/modifications for Ricky, except for reading, were successful enough to 
(warrant certification' of their success. Although, in reading, Ricky had made enormous gains 
(i.e.., the discrepancy was now 2.6X smalKr than during initial assessirent) , the reduction in 
discrepancy yas not bf sufficient magnitude to warrant complete program termination. Instead, 



the recommendation was made that indirect service through peer tutoring be continued. 
This information's summarised in Case Report Summary Twelve. (See pace 203.) 





FFOCESS: Communication and Collabolratioh 




' J ' 






. QUEST JONS 

f \ 

1^. nas prograrn Deen ^ 
successful in satisfying 
the needs of all ir^ter- 
esced parties? 


. M/\TERIALS NEEDED 




ACTION REQUIRED. 




'HfioaHor 
iiuation 


Program certification . 
review procedures. ' nj 

• / 




c' ' / • 
' ' / 

/ 

f 




II 

5^ ^ 
C> +^ 


Are all concerned persons 
aware of program outcomes? 
Are all satisfied? 

1 


Staffing Request Form. 




Hold program certifica- 
tion review with teami 
parents, student.. Make 
program certification 
decision. 






! 






Complete Part Three of 
Case Report "Summary 
Twe 1 ve . 




a; 








1^ 



Thi 



The final step in the program 
cert:Lf ij^ation decision is tire team 
staffi 



yg. All parties to the refer- 



Program Certification Review Procedures ^ 



ral should be present (or at least * • 

invited")' to participate in this decision regardless of which decision model is used. The data 
dre {^resented and each person is given the opportunity to review the data, comment on . the ^recom- 
mondations, and contribute .additional data or recommendations. Kor- Ricky, for example^ the progran 
'-ccctd£ic-a^45n decision is summarized on Case Report Surainary Twelve. ' 

; • Some Pinal Comments on Program Certification 

In Chapter II, we discussed problems that are frequently encomiterod >y resource teachers h 
wHpn they try to Identify desired performance. Thu importance of making those dcj^ircs expiiciy 
at the outset of>odifying a program is manifest in the program certification process. Desires 
previously unmentioned or forgotten very often cx.op up wheh \«»pi:iai educators, try* to gpt out of 
business with a" child. During program planning, commitments to satisfactory program completkin V' 
shouJ.d be,pbt'ained from all responsible parties, including general education staff, parents,/ and 



'special educators. This agreement should be established in writing as a part of the orlginil 
/planning contracts. If agreement is obtained, then individual values regarding the problems and 
/ their importance are negotiated well before consideration of whether the program has been s/it- 
^ Isfactorily completed. Thus, the commitment contract can be used as the basis for ncgotiiting 



O See P.L. 94-142 regarding parents* and students* rights do attend and participate. 
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eventjua^ program cert;if ication alo,ng the subjective dimensions which are always a part of program^ 
modifi<^'atiory decisions,. Gailagl^er (1?72) made. sj.milar recommendations, ''in our experience, the 

'more ejcplii^i^t th*^, ^^s!>nu-*a-JU<ul a^jreements at the pfjint^ of initial program modification the less 

difficulty ^id co^flijt cxiot at -the point _ of pYo*ji^<inf termination. No doubt it is impossible to 

-avoid some disagreement on s^4\,i?ccabions but formalizing the agreements prior to making deci- 
/ . • ' • K 1 , ^ ^ ' - ' 

sion^b certainlv helps to reduce* a g^reat deal of/ potential conflict. -i ^ . 

. y Perhaps final statement on the role of desir^ed j^erformance in making program certification 

decisions should be §iven. Although in e,stabj/ishing programs the tendency always is to act as 

if perfprmance dLscrepancies are reduced by changes in the actual performance of^the; student, we 
' • - " / i I , • / *^ * ^ ^ ^ ' 

believe that many problems can be solved mpre quickly^^and simply by renejgotiating desired perform- 
ance. . Tq do so^cequires that the individual/s vho are. responsible £01 t^e developmejf£ of children, 

within .educatiun^l prugram£> be persuaded somehow, that changes? in desired performance are reasonable 

• / ^ - / ^ I ' 

and called for. If our schools are ^ to be plural^istic , in the same senjse^that we presume our / 

American society is, then we must be open /to alternative developmental gpals as well as altern- 

-ative prograpis. To require all children lo llj^arn to do. or to become, the same (i.e.* desired / 

performance ^to be the same for all children^, fjo^i this viewpoint, is inappropriate. One of £he 

responsibilities of program modifiers shCuld^ be to impact on people/s desires as well as children's 

performanc^.* / < ' ' / 



\si^ui£ing Request Form 



To:/ Members of Student Support jfeam 
^rdm: SST Chalrmi^n^ 



A 



.Date ^ 1 



Heye U a list of the students jfor whtpm referrals have bdert recieved since our last .meet ing. 



/ 



/ : / 

^PJease list students whose programs should_ be revrewed 
, Implementation Evaluation Progress Evaluation/ 



Program Certification 



I . \ 



he SST vTTl I ponvene/ in the^Tesburce room at / 



on ) 



/ ^4jty7tJ . O^j ^. ' Return thiL form to the SERT prior to the meeting. \^ 



Uk recommend that thJ SERT chair this}-tean 



Rcfci/cncc 



Gallagher, J. J.. The special educatiod contract for mildly handicapped children. 
Exceptional Children J 1972, 38 j 527-535/ * 



H 

a 



CASE REPORT' SUMMARY TWELVE 
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Student ; 



GraUe 



Age 



/. 



Teacher 



17* What are the present progress/performance discrepancies? 

What are t he present discrepancy ratios for all behaviors modifie d during 

the program ? ^ ^ 7" 

What are the present data trends? "i- 



; Behavior 


Present Discrepancy 
Oate^^k^ / J /f7S> 


Change Over Initial Assessment 


Trend 


/l^ -.READINq PROGRfESS 


A7X Less 






MAT4^ PROGRESS 




3.\VX S/^)ijU^£/% . 




/ • SPELL iNd; 


/OX 






NOISE 









Should the program as presently planned and implemented be terminated? 
Has program beety successful i.n reducing discrepancies? 

Can^pther? assuiffe responsbility for thi s studen t ' s p'rpgram without assis'ta nee 
frorif Spec lal Education? ' "7 ' 



Summarize' data reviev/ and recommendations h 



ere. 




19» Has program been successful In satisifvinn np^i^^c nf ni 




Has progra m been successful ?n satisifying needs of all interested part i es? 

Are all parties awc^re of progcam outcomes? '"Z^ ^ ' 

Are al I satisfied? ^ - ' ^ ' * 

Summarize re"su Its of staffing here., * . 




T ' " ' 



J 7^ 5 , . 1 TB- mmnaa m a wnmi 



, Completed ^ja^jL. /99(f 

rCon t i n u5S ^ ' Difect 

^ jdirectj 
"Terminate , , . ■ 



Present, y?2^. jlQ/. 
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If decision matrix is used place matrix here. 





DESIRED 
LEVEL 



ACTUAL 
LEVEL 



DISCREPANCY 



Init 
Assess. 



4sx 



Change 



S(0.0 



3(>X 



DISCREPANCY RATIO VVORIjSHEET 

Uian 




Chai^ge from 
Intt Assess. 



/.AX 



BEHAVIOR 



Change 



3m. 



ange 



Change 



'Change from 
Init. Assess. 



/»3X 



le^3 l^zc^ /c^' 



Change 



Change 



lis 



Change 



^155 f€^f> t^l- 



Change from 
Inn. Assess. . 




BEHAVIOR 



DESIRED 
LEVFL 



ACTUAL 
LEVEL 



DISCREPANCY 



[lofi^ )oItc u/t 

fnir 



fnil. 
Assess 



MA. 



7-7- 



Change 



Change 



A2. 



fes: fe^ iesS 



Change f ro(n 
Init. Assess, 



Change 



3o 



Chan9« 




Change fro 



hange from 
Init. Assess. 



UK 



Change 



Change 



Change 



Change from 
Init. Assess. 



BEHAVIOR 



DESIRED 
LEVEL 



ACTUAL. 
LEVEL 



^tS ;/€55 ft^ofC less 



Assets. 



ISmc6. 



1— 

Change 



V6 



Change 



Ik. 



Change from 
Init Assess. 



/// 2./, 3/, 



Change 



Change 



4l 



Change 



44 



Change from 
Init. Assess. 



A7b 



Change 



4ii 



Change 



Change 



Chartge frot 
Init. Assess 



BEHAVIOR 


fess 










t2]n 


'A/ 








• . r 




^ Ina. 
Assess. 


Change 






Chanj^e f rorhv 
Init. Assess. \ 


Change 


Change 


Change 


Changa from 
Init. Asseis. 


Change 


Change 


Change 


Change trorn 
Init. Assess. \ 


otSlRED" 
LEVEL 








i 








— r 












ACTUAL- 
LEVEL 












3{0 . 




^\ 












DISCREPANCV 














h6>'X 












■ \ 


BEHAviOR 


ltt>s lets ' ■.yk<5 leS5 /e53 


\ 




Init. 
4. Assess. 


Change 


Change 


Change 


Change from 
Init. As>ets. 


Change 


Change 


Charjge 


Change from 
Init. Assess. 


Change 


Change 


Change 


Change from \ 
Init. Assess. ' 


DESIRED i 
LEVEL 






Ho 






No 




tit 








fib 




ACTUAL 
LEVEL 




























DISCREPANCY 














e 














*■ 

/ " 
BEHAVIOR 






'^Init. 
Assess. 


Change 


Change 


Chang}\ 


Changa ffcpm 
S. Inlt. Assess. 


Change 


vhangi 


Chang* 


Changa from 
Init. Asieei. 


Chan9* 


Change 


Chan^ 


Change from 
jnit. Asiess. 


DESIRED 
LEVEL 










"^M \ 






\l / 




Term 






/tkXf — 


ACTUAL 
LEVEL 




/id) 


'20 












36.CX 










DISCREPANCY 


ATX 




l.sx' 






I.DX 






IS'.OX'Sndller 










BEHAVIOR 


/n^e ftiore more mere \ ' \ 


'( 




Inlt. 
Assess. 


^tiamy 


Change 


C^■nge 


Changa^om 
Inlt. Assess.. 


Change 


Char>ge 


Chang* 


Cbtnoe from 
Init. AtitM. 


Change 


Change 


Charige 


Char>ge from 
Init. Assess. 


LEVEL 
























o/cft 






ACTUAL 
LEVEL 


3,6/lntn. 








In rJ^5crt 






no / 




>/? \ 


iect 






DISCREPANCY 


























j 
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IntrodjL^ict ion 



^'Up tO jthis p<>4^Jl^ ^BPM has been de:>cribed as /procedures t^^ solve the progress and performance 
problems of indi victual |StuJem^v^ S^^ecial education resource teac|iers play a key role in applying 
th6 processes of measiireirtent , e^aluaTTOr^y^nfi /Coinmunicaiion and collaboration to rdentifying 
students' ^problems aqdj j^J-dnnlng, iin^jlementlng,,. and adjusting programs to resolve the problems. 
Ttie presentation t^a-y t^etja ii-dde frOhi the. per sptct t ve of a prufess i-tafial SERT who assumes primary 9^:^ 
/shared » esponslbi 1 1 t>i-4 i rect serv ice-^for improving the individual studenT^.p'rogram. In this 
P^rt^there are outlined, the final ti*o j^rucesses managed by, the SERT, processes in which the per- 
spective is changed Ou=t. direct service to children to indirect or suppor i ive, service to chi I dren 
through the processes i^f consul tat I o.n .raining. The format of the following chapter differs 
from that fol lowt*d In'pr^.vious chapters. First, the rationale ^or the SERT's act i*^i tics in con- ^ 
sultation and training 4i>cu:>std, then con^^ul tat ion strategies and the matrix celt guestidtis 
3nd actrivl tics are li.>^;ed. UuUkc ^itln^r matrix listings, the mi'Xerxals and procedures to implement 
the activit ies diic i^cit' provIUtU In-^ttad, the reorder K rcfeired t*' appropriate preceding chapters 
l^r the neces.w^ inji^'>rnat ion . In t urn lusj ^u,. one consultative ca^e .study is 'presented. 



Cluip ter XI 



CONSULTATION AND Tl^AINING: 
PROCESSES FOR. ALL DECISION 
AREAS AND PROGRAM PLANS 



Contents 

Definition and Rational^ 

Strategies' for Solving 
Consultative Problems 

Matrix Questions 

Case Study 



Definition and^ Rationa-lc" 



Teaching--dirkt service— is a familiar r6le for SERTs. Developing skills to identify prob- 
lems r^plan^^ins^^ and implement and adjust instructional routines fit easily into their 
traditional role^cquxrements. Indeed, mo^t teacher education programs focus almost exclusively 
on direct' service| to ichildrehr"^---..,.,.^ ^ ^ 

In contrast,' providing indirect se^^ices to exceptional -children by consulting with ov train- 
ing classroom tc-jdiers is a less familiar role for SERTs and one^that is not easily understood"^ 
even ^"by the most exixerleneod te/chers. Consultation and training qnlarge^the SERr.s role and in- 
terj<|ct new facets in the professional relationship of the SERJ and. regular classroom , t readier. 
The first three 'steps in training SERTs as consultants and Leaclier trainers are (a) to establlsri ^ 
the goal, (b) 'to clarify the role, and (c) to justify Hie process.* 

The jboal* " * i ' " 

1 ' , • / _ , 

T,he goals and p?;ocessGs of consultation can be discussed from many points of view and a 



iety of theoretical models (Parker, 1975). 
jbs is to injure 'that a client, usually tne 



From our viewpoint, the goal of consultation for 
classroom teacher, implements DBPM for individual 



SERjb: 

students who are eligible for special education service. The measure of effectiveness, then, is 
th^ extent to which the SERT i^s successful in helping client ^teachers to use DBPM to solve the, 
idlntif fed progress ani performance problems of st\idents in the regular "classroom. 
^ j The goal of training in DBPM, on the other hand, is to teach to one or more people^ the 
skills that are need4d to use the procedures effectively. This Manual,, therefore, is a training, 
inqdium. The, measuri of effectiveness ih training is the dep.ree to which trainees Ian demonstrate 
skill in using DBPM with the sets of problems which are typically faced by the trainees. While 
success in consultation is determined by the client's effectiveness in working with the ST^h to 
solve the probleyns of specific students through DBPM procedures, success in training is evaluated 
by the extent t6 which trainees can^successfully implement the activities of DLPM regardless of the 



particiilar problem p resent^ecTand without the immediate assistance of the SERT. When DBPM has beoT 

Regular clasb teachers, aides, volunteers, cross^age tutors, parents, principals, social workers, 
psychologists. . .\ 

/A' • \- . ..... • . 
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learned through consultation, the learning is a secondary outcome; tlie learning is a primary out- 
come when it has been achieved through training. The difference between the two is a very fine 
line sometimes. The Justification for including both consultation and training as part of the 
^^EftT's responsibility follows. 

/ The Role ^ ^ . , . 

The simplest schema for clarifying the consultation role is that presented by Tharp & Wet7,el 



/• (Fig. XI-l), 



Consultant 



SHRT- 



^lediator ^ 



Classroom' 
Teacher 



Target 
ent 



Studel 



ERIC 



Fig. XI-1. The triadic model of consultation. Adapted-from-Ri ^ . 

Tharp 5 R. Wetzel^ Behavior modificxziion in the 
^natural envivoment. New York: Academic,! I969. * ^ 

. • • ' • ' ' i — 

In Tharp Wetzel's analysis, the consultative relationship describes "functional positions, not 
people who occupy those positions" (p. 47); ft^r our purposes, however^ the SjERT occupies the con- 
sultant position; the classroom teacher, the mediator role; and the student, the target role. 
The analysis clarifies that the SERT is in a consultative relationship with the teacher when 
(a) the student is the target of the change effort, (b) the teacher wo^rks directly with the stu- 
dent, and (c) «the SERT works with the teacher to help to change the stjudent's behavior. Earlier 
in this Manual (Chapter Vil) eight different types of service were presented for xionslderation 
when administrative arrangements were to be selected. Four of those types of service were 
identified as "indirect . " Examination of the triadic model makes it clear that all consultation- 
is indirect serviced tl the SERT occupies the mediator , position .and t^ie teacher occupies fhe 
target position,^ then the SERT is a teacher *trainer, not a consultant, ! But the activities of 
training are indirect service also as the SERT is not managing DBPM for a given student or 
students. . * ^ • | » ^ . 

Rationale ' ^ 

Not all special educators, and certainly not all classroom teacher^s^ accept .the position that 
the SERT should a^t as a .consultant and trainer. What, then, is the rationale for these role 
f.unctions? Five^^sons are offered here. » ! 

1. Since performance problems are defined as the discrepancy between what someone (usually 
the teacher) dealres and what someone (usuaily^the student) does, and since the appropr;iate S0IU7 
tion to the problem may lie in changing the desire ratTier th.in the behavior of the student, it 
follows that someone in the school rnay need to influence (i.e., to mediate or train) the teacher's 
desires as tUey are manifested in teacher behavior. '^- -^ 

2. Since teachers refer students to special education at a rate exceeding the direct service 
capacity of .specii^lt educatutt>, some mechanlbm for reducing the need for direct special education 
Service must be provided. * . , ^ ' 

3. Since education in the least/ restr^lctive alternative (environment) is mandated and most 
often interpreted as regular education classrooms, special education resources must be provided 
through the general education program rather than as a parallel special education program. 

4. Since teachers, 'like other professionals, inevitably confront problems for which assist- 
ance is required, the help should be readily available in the form of trained school-based (rather 
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Chan itinerant) professionals. 

5. Since the need for special education sometmes can be reduced best by systematic change 
in the school , program rather' than individual problem solution, resources must be continuously 
applied to improving the general educational program of a school to serve the needs, of exceptio 
children. , : " . . 

We believe that a school-based SERT is in a particularly* appropriate position « provide 
the outlined services] 



Decision 
' Area 



, Problem 
Selecxlon 



Program 
Selection 



'Consultation and Training Activities 
Consultation Activity . 
1. Teacher identifies the need for assistance from SERT in developing 
a program modification for a student in his/her class. 
2* SERT meets with the teacher to help pinpoint che specific behavior 
which the teacher wishes to modify. ' , 

3. ^*SERT^^ provides teacher with necessary materials and assistance to 
collect data on the discrepancy be^tween the student's current level of 
functioning and the desired performance for the pinpointed behavior. 

4. SERT liplps teacher to summarize the data collected and establisli. 
Importance of the problem. 

———————————— ■>_ _ 

5. SERT meets with the teacher and student (and parent) to develop a pro- 
gram modification. 

6v Guidelines are establisjied for Implementing and monitoring the . 
program modification and the responsibilities of «ill persons involved 
are defined. ^ - • 

7. Commitments are elicited from persons involved on their willing- 
ness to participate in the program plan. The result of this action 
is usually ift the form of a contract (Fig. xi-2). 



Program 
Opera tional- 
'izatlon 

4* 



Program 
Improvement 



Program _ 
Certifica- 
tion * 



8. 'Teacher begins to Implemont plan. ^ 

9. SERT assists teacher as specified in contract. 

10. SERT and teacher meet to evaluate effectiveness of program plan 
weekly or at least ^very other week. 

11. SERT assists teacher in summarizing data and generating alternative 
sti;:ategies on the basis of data collected by teacher. 

12< Teacher implements pro^'^Vam changes as agreed upon and continues with 
program- bperationalizatioa. * 



13. Teacher meets with student and parent (when appropriate) to evaluate 
objectives acjiieved and determine if program should .be terminated. 
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^onsultation Agreement 

Target Behavio r, i ^ ^* 


1. Fighting in the^hslls and on the playground. . }.> 

2. , Swearing in the halls, in the lunchroom, and on the playgrpund. 
3- Loud and boisterous behavior in the halls and the lunchrpom. 

Procedures ' . ^* N*^. — r- • ' 

Each morning the student will fill in a daily record tt^tm. This form wi 1 1 remain 
in the classroom and should be marked each time the student returns from an activity in 
which the behaviors listed above could occur, ^t the end of the day, a final evaluation 
will be made by the student and teacher. At the end of each week new goals will be 
set for the following week. ^ 

Student Responsibilities 

1. To f i 1 1 i n a da i ly record form each day. 

2. To be responsible for keeping count of target behavior. 

3- To check the appropriate spacQ on the daily record as soon as possible after 
the behavior has occurred. 

k. To summarize each day's ^tal and sign the daily* record. ^% 

5* To have the daily record signed by Che classroo{n teacher each day. 

Teacher Responsibilities ' ^\ ^> 

1. To provide the daily record form§. < 

2. To monitor the student's contract daily. ^ 

3. To allow time at the end of each day for evaluation with the student. and at 
the^end of each week for consultation with the SERT. , 

V To sign the student's daily record each day. 

5. To chart the student's progress weekly. 

6. To develop a reinforcement menu for the student for points earned. 

7. Jo set goals with the student each week. 

8. To C'3l 1 the SERT whenever necessary. 
SERT's Responsibilities 



To confer v/i^th the teacher ^^nd^hdl p to write a contract with the student. 
To help teacher to deyeropi^^ Y^Wforcement menu which has point values*' 
T;o aid teacher inv charting weekly* progress of studentT 
k. To spend one-half hour every Fr|day assisting teacher^ in goal setting for the 



next v/eek. 



/ 

1 



»Teacher'5. Signature SERT's Signature Student's Signature 



Date Completed 



Fig. Xl-2.. Consultation agreement among SERT, regular classroom teacher, and student 
identifying the responsibilities of each. 



2'M} 



Hore is 
toachor. 
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an.exaaple of a sequence of training activities conducted by a SERT with a classroom 



Decision 
Area 



Problem 
Selection 



Program , 
Selection 



Program 
Adjustment 



Program 
Certifica- 
tion 



Training Activity 

!• Teacher requests training irt DBPM!" ' , 
-^^Teaclier Selects. - sUid en t perceived to be having difficulty with 
classroom activiti'es. 

3. ^SERT .ind teacher review data on history; intervitw student (and parent), 

4. SERT provides mattlVials, and training in their use, to enable claSs- 
room teacher to collect data on discrepancy bet\^een scuden.**s current 
level of functioning and' desired performance for the academic behaviors * 
identified. 

SERT , provides training and ^naterials to the^classroom teacher for 
collecting data on social behavloc^f target student and peers* 

6. Teacher collects data on acaciemic and social behaviors. ^ 

7. SERT provides training to teacher which enables h^r/him^to summarize 
the collected data; write a rationale for tha Importance of the problem. 

8' SERT trains teacher to evaluate data and develop a program plan for the 

high-priority behaviors identified. The plan may include peer tutoring. 

Teacher agrees to participate in supervision of peer tutoringV* 
V ' 

9f SERT implements activities for training peer tutor and teacher to 
opera tionalize program plan. - o 

10. SERT supervises as teacher monitors peer^tutoring program, and SERT 
trains teacher to summarize data coilected. 

il- SERT trains teacher to evaluate data collected and decide on program 
adjustn^ents, ^ 

12. SERT meets with teacher to eValuate objectives achieved and ^determine 

•v ^ » * 

if program should be terminated. ^ 



An example of a trainir ^ agreement among a SF.RT, classroom teacher, peer tutO^. and student, 
which covers activities and materials for program impletoontatlon, is given in Fig. Xl--3,\ \ , \ ^ 

To summarize, in consultation,, the SERT helps somepne else solve, specif ic problem^a> u^jJLng BBPW^;^.^ 
procedures rather than solving the problem alone. And in br^iining, the SERT^s.^bje»,tivc is to^^^^^^S^ 
teach other persons to use DBPM procedures. . /^^^tt,*' \^ 

The procedures and materials needed to provide Lhesti services should be developed fpr. ttie , 
particular person or situation in which consultation or training is being offered. [ \[ 
Strategies for solving consultation problems (see also Chapter VII ) 

Assuming personarl responsibility for insuring that programs are implemented by others as' 
planned is no small step for the SERT. The immediate responsiblity assumed by the SERT is for 
the service that is provided to the rejferred student by others, a responsiblity that may produce 
discomfort. Typically, the SERT's teaching eno^leagues are not familiar with the con:ept of 



Training Agreement 



( D SERT Responsibilities ; 

1. To train peer tutor and student, to dev- 
elop and operational ize program plan. 

2. To monitor the program for interventions 
. and incentives. 

3* To provide sample sheets, for taking 
daily rates in basic facts. 

^. To provide material for practicing 
facts each day. 

5. ^ To provide sample materials for deter- 
mining mastery of skills in the math^jsequeqce. 

6. To provide graphs for the tutor, the 
student^and the teacher to record data on 
progress/performance in math, 

7. To trai|i tutor, student, and teacher % 
in graphing procedures. ' 

To^^spend pne-hal f, hour in the classroom 
each Thursday to monitor program and*assist 
in setting goals for the foljowing week. 



(2) Peer Tutor Responsibilities : 

1. To practice facts with student each 
day for 10 minutes using procedures 
taught by SERT. 

2. To get a one-minute written sam- 
ple of the basic facts from the fact 
sheet each day. 

3. To assist the student fn summariz- 
ing and plotting his data each day. 

To record information of daily 
timing on sheet provided by the SERT, 

5. To me^t with SERT for 1^ minutes 
on Thursdays. ^ 

(h) Teacher Responsibilities : 

1. To arrange space in classroom for 
^ peer-tutoring activities. 

2^ Tp. see to it that all materials 
are ^a i lable. 

3.. To check'-graph and summarize data 
with peer tutor and student. 

To meet with SERT on Tlrursdays to 
evaluate data and set goals for 
fol lowing week. 

5. To administer the weekly mastery 
tests.. 



(3) S.tudenr Responsi'bi 1 i ties ; " 

I. To plot his daily progress on the daily, 
graph. 

ZJ To work in a cooperative manner with his 
peer tutor. 

* 3. To practice the basic facts of.mul*ti- 
pl icafion dai ly. " 

Directions for Peer Tutor : 

Using the rate sheets given to you by the SERT,, get a one-minute sample of the 
student's performance each day. Have the student skip the problems he does not know 
, during this one-minute sample. At the end of the timing count the total number tried, 
then subtract the number of incorrect tries. This will give the number of facts correct 
and incorrect/minute. Help the student to graph the number of facts correct and the^ 
number of facts incorrect on, the daily performance graph. 

Directions to Teacher : ^ X 

Once a week, take a five-minute sample of the student's progress in mastering the., 
skills in the math ski 11 sequence using materials supplied by the SERT. At the end of 
timing count the total number of digits correct and divide by 5. If the rate of digits 
correct per minute is between, 50 and 75, plot a mastery point at the intersection of the 
line representing the skill on the vertical axis and the line representing the calendar 
week on the hori^jontal axis; ^ 



.1^ 



Fig. XI-3. Example of agreement for responsibilities and materials for training in 
program implementation. The pinpointed behavior is ff of mul t ipl ica tio 
facts correct/min. 



# of mul t ipl ica tion 
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"shared responsibility"; for them, a student's day is divided among curriculum areas like"reading" 

/ ' • • " ' 

and "math" or pervices like "regular," '^special, " ^nd "remedial," in which each teacher assumes the 

right to "do^his/.her o^>m thing" with the student. Even in continuous progress or "open" programs 

teachers do not expect colleagues to follow the same instruction, even informally. Teachers are 

trained to function individually rather than as team members. 

When the SERT shares responsibility for a discrepant child's program, uncertainty and conflict 

are common ^^initially in the relationship with the classroom teacher. A common response to this 

problem, if the SERT consultation role is not a familiar one, is to avoid and escape those in- 

direct sejrvice activities that produce conflict and to concentrate on the more familiar direct 

^ervice functions. In one school district^ we have been told that although special education 

t^fichers^ wqre provided with from 25-50 percent of the day for the indirect service activities which 

are required by the consultant role, within five months of assuming that role virtually all of the 

special education teachers had returned to 100 percent direct service to children. Their chief 

explanation was that the regular classroom teacher "didn't want to work with them" and were "un- 

cooperative." 

How does the SERT succeed in operational izing a program as a cooperative venture? No simple 
answer is available, unfortunately. However, teacher performance is influenced by the same general 
printiples that influence student performance. A systematic analysis of the performance problems 
occjtrring during program operationalizatiun can be helpful to the SERT who identifies discrepan- 
cies between the desired performance of iraplementors written into the program, plan and the actual 
performance of those impleraentors during program operat ionalization. Mager and Pine (1970) have 
provided an excellent framework for cinalyzing such problems. A few simple questions from that 
framework are helpful to stimulate solutions to common performance problems. 

^* Is the performance expected (desired) from each implementor clear? If not, the SERT can 
demonstrate the performance or write it into a contract which all may sign. * 

2^ Is tlie actual performance of an^ impXemeptor substantially discrepant from the desired 
performance ? To answer this question it may be necessary for the SERT to observe the implement- 
or's attempts to perform as desired. 

3. If a discrepancy exists, is it important ? If a discrepancy i& not important to probable 
program success, ignore it. If it is important (and to so determine you may need to communicate 
with oth&r concerned parties), then try to determine why the implementor is not performing as' 
desired. 

(a ) Is the performance something the implementor can do, but is not doing ? 
If so, the problem is not due to a lack of skill and can be solved if the 
SERT can take the following actions: 

Change thu consequences that occur when the implementor performs as desired . In doing 
so, remember that the *. un&equcnces operating on the implementor can be both positivt* «ind negative. 
A person may be able to do some tiling but will refrain fron it if the Result is unpleasantness. For 
example, a. teacher may be able to observe and record Lohavior but dues not because other students 
become disruptive, during the pn^ce^s. In ;ffeet, \w i.s being punished for carrying iUit an import- 
ant component of DBPM. To get the teai.her to observe and record the target student's behavior, 
the SERT must make sure that the punishment does not occur. Similarly, a teacher may be <ible 
to man«':ge a peer-tutoring program in the t lasi>room but at the cost of time ordin«iri]> devoted to 
evaluating students' work. Again, the SERT can effectively remove the unpleasantness by using , 
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indirect service to ensure that performing as desired does not cost the teacher valued time, 
finally, initial attempts by the implismentoc to perform as desired go unrecognized, too often. 
The SERT can insure positive social con^sequences for even small approximations of desired perform- 
ance by daily checking in with the implementor to "see how things are going." These "stop-bys" 
by the SERT and the principal, counselor, or social worker emphasize the importance of desired 
performance and provide the occasion for social reinforcement. (Notes to the principal^about godd 
efforts by implementors are especially effective reinf orcers ! ) 

(2) Make the desired performance easier for the implementor to accomplish . Fur example,, 
data recording is much easier to do if all the materials are provided and are easy to use. Imple- 
menting an alternative curriculum in the classroom is easier initially if someone else provides 
the materials, plans the lessons, provides directions to the btudent, and organizes^ the time and 
space. Managing a peer-tutoring program is easier if someone else recruits and trains the peers, 
organizes the lessons^ and develops a daily system that results in dlearlyocganized graphs for the 
teacher to inspect. All of these'^^hings may seem to be things the teacher "really oughta wanna" 
^do (Mager & Pipe, 1970) without so much effort from the SERT; yet they may be the very things, 
wiiicji need to be done if a program plan is to be operationalized.. The way we wish for 
things to be are not always the way they are. 

(b) Is the desired performance something the implementor does not have 

the skills to do ? If so, two options exist. 

(1) Establish a program to train the implementor to carry out the program. If, for example, 
the teacher dues not know how to write behavior c&ntracts with students as required by the pro- 
gram plan, the SERT can teacb the teacher. Similarly, the teacher who cannot do a task analysis 
will have to be taught how to do so. Training the teacher is initially time consuming but it has 
long-term benefits in both the prevent ion and remediation of problems with other students. On 

the otht r hand, immediate program opt^rat ional i/.ation may require a less time-consuming solution. 
Ir» Such cases the second option may be. used. 

(2) Sliift the implementation respunsibl lities to someone who already has the skills required 
for prugrani opcrat ionalization, such as the SERT. But then the SERT would be moved into a direct 
service role, which may be undesirable. If the target child is likely to need service for an 
extended period, changing the child's teacher may be a good alternative. Changing teachers with- 
out conflict, hi>Wfcver, requires careful .and sensitive management and" Is most easily done where 
the reassignment of responsibility is common (as in team teaching). 

The preceding strategies are not exhaustive. In general they include a wide range of altern- 
atives for so ving perfornjnnce problems. (Mager & Pipe (1970) provide a more thorough under- 
standing of the principles involved and, with practice, a limitless number of specific soltitions 
can be generated from the principles.) 

A case study 'follows in which a SERT consulted with a classroom teacher. It is present-'* 
ed to provide a model for consultation activity; however, it should not be construed as repre- 
sentative of all c ons ultative possibilities. The case study format is a modification of the forms 
presented in Chnptt th IV-X and it is used by the StRT to structure tlie consul tat ion' with ^:lass- 
room teachers. The mod ifici»t ions meet the requirements of the consultative arrangement. Thu.s 
they do not include information on the eligibility decision or form«al periodic reviews of 
the student's program by the building team. 
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> Do*s and Donets for Consultants^ 
.DO ^ . DON^T 



remember that people are capable 
of solving their own problems 



• try to accept others' val ues 

• be fully aware of your own val ues 

• have a specific way that teachers 
can get your help 

• be knowledgeable about all school 
& community resources available * 

• to save time S help more teachers, 
learn how to use. your services; 
meet witH a' teaching' team or ' 
department at meeting times 

' have a wide variety of materials 
'/ to help teachers , ^ 

• let teachers know you value their 
* knov;l edge 

• try to be involved in school 
acti vi t ies 



'.tell a teacher you v/rll help with a 
child without spelling out exactly 
what you thinK your responsibilities 
are 

' don't schedule yourself so tightly 
that you don't have' time to meet 
with teachers for immediate 

V consul tat ion , 

• act as if yoa have all the answers 
to solve a teacher's problem 

' become^the ^'middle man" to take 
teacher's gripes to the principal 

• don't push when the consul tee is / 
not ready to move 

' don't let your need to help get in 
the way of the needs of the 
consul tee / . 

/ 

don't expect to see immediate results 
— you'll get discouraged 



There follow the matrix questions 
four decision areas and program phases, 
flow charts presented in Figures II-3, 



for the process of consultation and training through the 

If you recall, these questions were. omitted from the 
4, 5, and 6. The case study follows the matr^ix questions. 
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Process: C(;<nsultation and/Training 
MATERIALS NEEDED 



DECISllON AREA: 
.Pvob}em Selection 



ACTION REQUIRED 



PRGGBAt} PHASE: "'r 
Intake Assessment' 



k. Can. the SERT help or train 
others to select problems for 
program modi ficat ion? j 

Are there other persons who 
can be-helped or trai^fed to 
collect discrepancy dcita, 
conduct interviews, apd establish 
priorities and eJigib'ility for 
service? 



'Chapters IV, V, and 



Corjsult with or traip others ' 
(ajdes, regular class teach--; 
erk) to collect discrepancy 
dat^, 9onduct interviews, apd 
estab.llsh priorities and >' . 
eligibility for service, v 



IDECTSION AREA: 
j Program Selection 



'PROGMM PHASE: 
Progtpm Planning 



8. ^ Can the SERT help or train 
others to select programs? 

' / 

.Are there other persons who can be 
helped or trained to propose 
alternative programs, write 
objectives, determine measurement 
procedures? * 



. See Chapter VI I, 



/, Consult with or train others 
; to .propose a 1 ternative; pro- 
/ grams, write objectives, and 
determine measurement pro- 
cedures. 



DECISION- AREA:' 



Program Operationalization 



PROGRAM PHASE: 



Implementation Evaluation 



12. Can the SERT help*or train 
others to operat ional ize program 
plan? 

Are there other persons who can be 
helped or trained to implement pro- 
grams measure performance, and 
evaluate extent to which program 
plan is being implemented as' 
proposed? 



See Chapter VI I L 



Consult with or train others 
to implement, measure, and 
evaluate programs. ' 



DECI'SION AREA: 
Program Adjustment 



PROGRAM PHASE: . 
Progress Evaluation 



16. Can the SERT help or train 
others to improve programs? 

Are there other persons who can be 
helped or trained to evaluat/e pro- 
gress, propose program changes, 
and adjust programs? ' 



See Chapter IX. 



Consult with or train others 
to evaluate progress and make 
recommendations for further 
program modi/fi cation. 



DECISION AREAr 

Program Certification 



PROGRAM PHASE: / 
Outcome Evaluation 



20. Can the SERT help or train 
others to: certify programs? 

Are there other persons who can be 
helped or trained to evaluate 
whether program should be 
terminated? 



See Chapter X 



Consult with or train others 
to evaluate progr'am outcomes 
and determine whether program 
should be terminated. 
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CONSULTATION: SUMMARY REPORT 



Ms. R. 




Ms. J. 




Devin P. 




2 




8 ' 


Teacher ; 




SERT 

o 


Student's Name 


Gra'de 




Age 


1; PROBLEM SELECTION 

1. Who owns the problem? 
























Date 



^1s. R. asked 



the , SERT to help develop a program to increase assignment 
compel et ion y{>f one student in her class. At the present 
time, the student is not completing' more than one of five 
assignments per day. ' ' * 



Are the problems those the parent identifies? , Pa rent is 
very concerned about student's work. She is willing to do 
whatdv^r the school requires to help Devin improve. (See 
also iattached questionnaire.) 



Are the problems those the student identifies? Devin does 

, , 

not l.ike school. He feels the teacher is always picking on 
him. J He never gets free time as he is alv/ays bbing kept in 
to finish his work! This makes h>m very angry. (See also 
attached questionnaire.) 



Other ; comments : Teacher believe*^ Devin' s problems are not 
due to skill deficiencies but are primarily a problem of 
motivalt ion. , 



A. Here the data. col lected 
during^ i ni t ial- x:onsul tation wi th 
interested part ies are summar- 
ized. The SiERT and the teacher 
decide who wijl do each inter- 
view. _ 



EXAMPLE j 



The SERT me*t with the teacher 
to pinpoint the problem. 



Devin's parents and the 
regu.lar class teacher met dur- 
ing regu lar. conference period. 



The SERT met with the 
student to give him the oppor- 
tunity to express his views on 
the problem. 



2 . .What problems have been identi f led as important? ^ 



1 


TEACHER 


PARENT 


STUDENT 


OTHERS-- 


MEDIAN 

OR 
AVERAGE 


Assignments 
, Comple ted 


1 


1 


No 
OpI nion 




I 



















































Each person interviev/ed was 
.asked to rank the identified 
problems in terms of their 
relat i vc . importance. 



''These, ar^i different for each-student 
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CONSULTATIOIg: SUMMARY -REPORT 



, EXAMPLE. OF A STUDENT QUESTIONNAIRE 



1. If I had three wishes »'d ask for 



Date 
candy» dinpsa 



2*. The best thing the teacher can /do is iiot to yel 1 
3. My favor i.te game. is bike riding ' 
k: I 1 ike to get 



Devtn P. 



Student ^s Name 

• ■ ■ //- , 

ur model » comic books 



t me 



/ 

pop and /candy % 



5. My best friend in school is -John P. - 



6, The best place in the school is the playground 



7. The school period J lik^ best is recess 



8. When I get my school worK done I like to go out to^ p/lay or haye free time 



9. The best thing that could happen to me in school is ' to get my wor'k done 



10. If I could do anything in school, that I wanted, I would watch tv 

11. The most fun that 1/ have in school is I don' t 1 ike school 



12. The subjects I neefd the most hel^; with are I don ' t know 



13. The subject I wapt to work on' first Js I don' t know 



1^. If I could have help with getting my work done I would be able to go out and play 

15. If I knew I could I don't know I'd work on my 

, every day for at least ^ mins. /hours. 

\ 16. Ai 



Ask student to complete the priority ranking- sheet. 
\ ' ' . 

\ (See-also questions 12 S I3.) 

\ ^ - . . 

Additional comments: * 



23S 
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. . . CONSULTATTON: SUMMARY REPORT 

EXAMPLE OF A PARENT QUESTIO>jNA IRE • _ i 



Devin P. 



Date 



Student ' s Name 



What, people does* your child spend the most 'time with? 



Younger brothers and sister 



Mom and Dad 



Are there others he or she v/ouldMike to be with? ^ . » 

> 

Not particularly.. Devin is a loner. 
Where does your child spend the most time? » • ' ^ 

!n front of tv. v -* | 

Where would he or she like to spend more ti.me? . ' • 

Don' t krtow. . , 

L*st the things your child spends the most time with. 

When not watching tv likes to pla/ with dinosaur models, read comics, use magic marker 
.pens. 

List th ings your'ch i Id doet>"not have but would most like to have. 

Magic marker pens . . 

List best*- liked foods and drinks. 

Gum, candy, pop, hot. dogs' 
List the activities your child spends the most time on.. 

Same 

List activities he or she would like to spend more time on. 
TV.. 

Select and list four reinforcers w;hich are the most powerful and which you are able to offer 
to your child contingent upon his or her behavior. 

1. Models * * " 

2., Candy 

3. Trip to McDonalds 

Comic books 
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consultation: 



Ms! R. 



Ms. J. 



SUMMARY REPORT 



Dev.in P. 




Teacher 



Student's Name 



SERT 



What IS desiVed performance? 
What is actual performance? 
Is there a disoVepancy? 



2 

Grade 



8 
Age 



Date 



BEHAVIOR 


Assignments 
Completed 




I 




-DISCREPANCY . 


10. OX less 
than de- 
sired 


- !. 

f 

f 







6. Here the data collected 
during initial assessment of 
the problem are summarised. 



I EXAMPLE i ' 
Nine consecutive days of 
baseline data were coj lec ted by / 
Devin's teacher on assignment 
completion. The_SERT summarized 
the data and plotted them on a 
daily perfoirmance graph. 



6. Is there a history of progress/performance 
» problems? 



Devin has no previous history of Special Education service 
or referral. 



40 
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CONSULTATION:- SUMMAR,Y REPORT 



















1 Ms. R. 




Ms- J, 




Devin R. 




2 





8 



Teacher SERT Student's Name Gr ade 'Age 

V 

7* Is the discrepancy important? 



Date 



Baseline data indicate that Devin completes 10. OX fewer 
assignments than a.§sfgned. The classroom teacher wants 
him to complete all assigned tasks, as the believes Devin 
will not be able to succeed in school is always 

falling behind in his work. Devm would like to comple^te 
work so he can have ^ree time but at this time he says 
he can't work because he feels the teacher is always cross 
with him. Devin's parents agree this is an important 
problem and would like to help in any way they are asked. 
If Oevin is to succeed in school -^me assistance from an 
outside party seems appropriate. 



The SERT writes a rationale 
for the importance of the pro- 
blem in which she justifies thei 
need for consultative service. / 
I EXAMPLE.! * / 



The SERT wrote the rationale 
.regarding the importance of the 
problem and asked the teacher 
to review it and comment. 



1 ) V 



• V u 

•■•/~, .„ 



2'IJ 



consultation: summary report 



Ms. R. 



Ms. J. 



Oevin -P. 



Teacher 



SERT 



Student's Name 



mm 



Grade 



8. Is consultation appropriate for 
this problem? 



Age 



Date 



This problem meets the criteria f6r consultation in H. 
.school and therefore a program modification will be dev- 
eloped by the classroom teacher with the SERT*3 assistance 



D. The decision whether ser- 
vice wi 1 f be provided is 
reached .using criteria estab- 
lished at the school or dis- 
trict level. 

I EXAMPLE I 
In H. rSchool this decision 
does not require a studept 
support team staffing. In* 
direct service depends upon the 
SERT's previous time commit- 
ments and the type of problem 
presented. 

The SERT assessed her time 
conpitment and the appropriate- 
ness of this problem for con- 
'^sul tative jservice. Based on 
the rationale, regarding «the * 
importance, of the problem the 

SERT agreed to provide assist- 
♦ 

ance to thje teacher in devel- 
oping a program for Oevin. 
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CONSULT AT.l ON: SUMMARY REPORT 



Ms.^R. 



Ms. J. 



Devin P. 



Teacher 



SERT 



Student's Name. 



Grade 



II. PROGRAM SELECTION 

1 . What performance discrepancies 

have been identified? 
1. What is the administrative plan? 



Age 



Date 



*List discrepancies for which program nxjdJf ication w'i 1 1 
be developed during consultation. 

Assignments 



Completed 



E. In consultation with the 
teacher a program plan is 
developed. * * 
I EXAMPLEj 
Together, the teacher and 
the SERT developed the program 
plan which is outlined here. 



Outtine general plan and adn)inistrative arrangement. 

The classroom teacher and SERT will develop a contract 
which' describes the responsibilities of all parties. 
The contract format will also be used between Devin 
and the teacher. Contingencies for completing assign- 
ments will be specified. A daily task card will be 
filled out by the student and teacher indicating 
assignment completion. 
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CONSULTATION: SUMMARY REPORT 





Consultation Agreeme*nt 


Teacher. Responsibli ties 


1. 


Write a contract with student. 


' 2. 


Help student fill in the task card'.. , 


3. 


Remind student to fill in his/her name and date at the beginning of each day. 


. A. 


Briefly discuss the task card with student at the end of the day.^ ^ 


5. 


Sign each task card "at the end of the day. 


6. 


Develop a set of potential reinforc^rs for Devin to^earn. 


7. 


Make sure Devin has time for the activities he earns each, day. » 


SERT Responsibilities 


1. 


Inform all personnel involved of thei r respons ibi 1 i t ies under the contract. 


2. 


Provide task cards for Devin and the teacher. ' \ 


%. 


Summarize data collected by the teacher and plot them on the performance graph(s). 




Help the teacher to develop o set of potential rei nforcers ^or Devin. 


5. 


Meet with the teacher weekly to evaluate the prog^ram arid set new goals. 


Procedures for Implementing Plan " 


1. 


At the beginning of each assignment make sure that Devin understands the directions 


for completing the task and what is expected of him. 


2. 


Be sure Devin knows what potential activities he can earn. 


3. 


At the end of the day, fill out the Daily Task Cardowith Devin and.make sure it is 


marked correctly. If the assignments *are not completed, try to pinpoint the reason 


and 


write it on the bottom of the form. 




Take the reasons for not completing the assignments under consideration when 


planning the jiext day^s assignments. 


5. 


Be sure Devin has time for the activities he earns each day. 
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CONSULTAT-IOMl^ -SUMMARY REPORT 



Ms. r: 



Ms. J. 



.Devin P. 



Teacher 



SERT 



30 What interventions are proposed 
to reduce the discrepancy? 



CONDITIONS 



BEHAVIOR 



Long 
Range 



By the end of the 
school year when 
given, a set of 
assignments to 
complete 



Devin will com- 
plete tasks 
ass ignedCv 



Week 1 y 



Each weeK when 
given a set of 
of assignments 
to complete 



Devin wi 1 1 com- 
plete tasj<s 
assigned 




8- " - • - 



Student's Name Grade 



Age 



Date 



CRITERIA 



100% of the 
time. 



a.t a median 
jsercen.tage which 
fs^at least 10% 
greater thian the^ 
pr'eviouSi week.' 



F. Long range, weekly, daily- 
object i'Ves and program changes 
for ea^lV'pTogram modification 
are written by the SERT and 
the teacher, firaphs are seN 
ected^and responsibilities for 
col lectingand summarizing 
data are assigned. 

i EXAMPLE I 
Together ne teacher and <he 
SERT WP<5tb long-range and' 
^ly program objectives.. 




Contract" 1 - Devin can earn 10 min. of free time at the end 
of the day if all tasks assigned a re completed and checked off. 

Contract 2 - Devin can eaVn 10 min. of free -tinje before lunch 
if all assignments' for the>morning are complete. 

Contract 3 " Devin can earn 1 sti-cjker for each assignrrent com- 
pleted which he can trade for a variety^of j tems (see contract) < 



A. What are measurement procedures? 



What behavior will 
be men i tored? 



Assignments 
Completed 



Who wl 1 1 graph 
data? 



Teacher 



What graphs will be kept? 



MONTHLY PROGRESS PERFORMAN CE 
WEEKLY PROGRESS' (^R^FORflANC^ 
. PROGRESS PERFORMANCE 



Who wi 1 1 
col 1 ect 
data? 



Teacher 



Who'wi 1 t summarize 
data? 



SERT 



Who will evaluate data 
and develqp new goals 
and .progfam changes?" 



SERT and teacher 



^ i EXAMPLEl ' ' 

Graphs and measurement pro- 
cedures were selected. 
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Task CaN 1 
Devln* 



.CONSULTATION: SUMMARY REPORT 



OeVin will ^get a 7 for every assignment completed during the morning. At the end of 
the day Devin will get 10 minutes of free time if he has completed all his assignments 
for the day.^ 

Student^s Name 



Date 



# Tasks Assigned 
/? Tasks Completed 



# Tasks Not Completed- ^ 



/ 



Student's Signature 



Teacher's Signature 



EMC 



4 1) 



CONSULTATION: SUMMARY REPORT 



Task Card ^2 
Dev in 



Wr 1 1 ing 



Math Sheet 



Date 




Spel I ing 



Teacher ^^J)l4j . * 
signature . 

Student T) (^y ( Y\ 
signature 



Reading 
Workbook 



Oral 
Readi ng 
wl th 
tape 



5 stars = 10 minutes 
free tjma 
before lunch. 



ERIC 
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ERIC ; 




CONSULTATION:, SUMMARY REPORT 



tract (3) 




a^ree to complete 

assignments given to me each morning. I ^hali 
list each one on my task card -and shall receive 
one;,;(J^^ -For each task I do. \ - ' 

I can trade, my 5ticker5 -for: . 

3 sticlcers = 1 piece candy 
10 stickers = magic marlc<!r/-felt tip 

(5 Stickers = comic 
-^0 stickers -= a dlriOSaOr- model - 




, agree to present t>«vln u;itin a <3^S^ 



, -For each assignment he completes each mbrninj. X 
alsQ inft/a{ his task card. 




o 



X Hd^. "Z. a(^ree to provide 

task cards, Stickers and t:ar\(^thk 
rein-force ment^ -for T)e\/i.n*5 : 
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CONSULTATION: SUMMARY REPORT 



Ms. R. 



Ms. J. 



Devin P. 



] [ 



Teacher 



SERT 



Student ' s^ Name Grade 



Age 



ML 



Day 1 



Date 



Day 2 



Date 



Date 



Day 5 



Date 



PROGRAM OPERATIONAHZATION AND ADJUSTMENT 

1 . Is program plan being Implemented 
as proposed and accepted? 

2. Are changes being made systematically? 



Date 



SERT met with teacher to review data and discuss problems 

which may have occurred. Teacher had not filled out task 

card with the student as there had been a fire, drill at 
• the end of the day. * • 



6.' Daiiy reviews of the pro- 
gram during the first week are 
imperative! The SERT need 
only "stop by" momentarily. 
Subsequently reviews are 
scheduled weekly and- summarized 
in log form as noted here. 
1 EXAMPLE I 
The log kept by the SERT 
for this consultation is 
reported here. 



SERT left note on teacher*s desk before school to remind 
her about task card.^ Check a^ain at end of day showed 
that the student had ~not completed any assignments. 



Day 3 50^ assi^riments were completed today but teacher express- 
ed concern that feedback is too renx)te.x,'^ecided. to 
>/ait until Friday and then decide i f C^tx^^r^t i^shbisYd-^ 



be irflplemented.. . 



A check at end of day ind^(x:1ft^i'^^*^^ss'ignm^nt com- 
pletion. Decided to cont inue as abc^^ve.; fqr^^other 
week. 



Day 10 '/Devln's performance is very variable. 

implement Contract 2.. 

Date 



Teacher v;i 1 1 



ERLC 



2Ad 
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Oevin completed 80% assignments on the fjrst day of xhe 
nev/ contract and 100% on the second day.. His performance 
is still variable but will continue this contract for 
another week as % correct per day'js still above the 
estimated performance line. 



Day 20 


Al 1 data points 


were plotted below the line this 


week. 


Date ' 


Contract 3 v/i 1 1 


be implemented next week. 






Day 25 


Devin completed 


100^ of assignments for two days 


this 


Date 


week! 







Day 30 


Four 100^ days! ! 1 




Date 

i 








Day 35 


Despite an initial 


,drop to 60Z on Monday, Devin 


Date 


completed 100^ ass 


gnments ^on 3 days . 



Day ^0 


100'^ on 


four of 


five days. Teacher will continue this 




program 


wi thout 


further assistance from SERT. 


Date 









pay \5 
Date • 



COI^SUL-TATION: SUMMARY REPORT 



• VMS. J. 



Devin P. 



'8 



Teacher 



vSERT, / ^ Student.' s Same Grade Age 

IV. \ PROGRAM C?PJIFICATIONa^', 

1 . Did program produce-'^ curf)ctlati ve 
benefits for, the student ? Date 

2. Which changes had greatest effect 
on performance? 

Performance* increased during all prografh pha^ijes. 



% Assignments Complet^id 


Basel ine 






Change 1 




m ^ 1 


Change '2 






Xhange 3 




100% / 



H. The data for the program 
were summarized by the SERT: 



I exampleT 

The data for Devin' s 
program w^re summarized by the 
SERT. 



Summarize discrepancy data. 



Baseline 


10 


OX 


'less than desired 


Change 1 


3 


OX 


less than desi red 


Cl],ange 2 


2 


5X 


less than desired 


Change 3 


1 


OX 


- No Discrepancy 


Change Over Initial/^, 
Assessment 


10 


OX 


smal ler 





* — # 



8. 



SSPooo o o o 



251 



/ 
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CONSULTATION: SUMMARY REPORT 



Ms. R.. 



Ks. J. 



Devin P. 



Teacher 



SERT 



Student's Name Grade 



Age 



3« Wha{ recommendations are there for 
further program modification? 



Date 



Teachjrwill continue to implement Phase 111 of program. The 
reinforcement "menu" appears to have been the most effective 
change planned for Devin' s program. 



PROGRAM CERTIFICATION 
/ 1 . Should consultation be terminated? 
/ 2. Has consultation been successful in reducing the 
discrepancy? 

3- Has consultation satisfied the needs of all inter- 
ested parties? 



Consultation has been successful in reducing the discrepancy. 
SERT will continue to check with teacher to! see if student — 
maintains this same level of performance. "1"^'^'^ 



I . Teacher and SERT try to 
identify which changes had the 
greatest effect on performance. 
I EXAMPLE I ' 
The SERT and teacher met to 
evaluate changes and decide on 
future program plans for 
Devin. 



J. Teacher and SERT review 
program plan and summary 
discrepancy data. 

[example I 



Th e ^ffeW" a n6^jL^e^tea c h e r 
\ 1 SO cej^t|fi e>d .gtogrjfm 



I 



com- 



^. Continue/fterminate*\ Consul^tation . /■ '7/ ; . / 



Date '-i^Xv- 



SERT 



7)Uj, /6. 

Teacher 
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APPENDIX A. 
Matrix Questions 



ERIC 



'~0.i 



DECISION AREA: Troblem Selection PROGRAM PHASE: Initial Assessment 
PROCESS: Communication and Collaboration 



"QUESTIONS . , • 

1. Who owns the problem? 

• Are the problems those the 
teacher identifies? 

Are- the problems those the 
^ ' .student -ident i fies? 

Are the problems those the 
.parent identifies? 

Are the problems those the 
School principal or other 
.professionals identify? 
Are they shared problems? 

Should other 'prpfes^iona Is 
be cons.uUed? ' " 

' Do those^h*p-i<f<*n'ti-fY 

p rob 1 em ( s ). 'h'avV PiTl 0r i ties 
- as to thei r Jmptjffcj^nce? 



MATERIALS NEEDED 
Referral form. 

Procedures for arranging teacher 
conference. 

Format for teacher conference. 

Procedures forarranging student 
conference. (5/ 

Formart for student conference. ^ 

Procedures forarranging parent 
conference, 

Format for parent conference. 

Procedures for arwnging staffing; 
consultations. Q^ 



Procedures for determining 
priorities. 



ACTION REQUIRED 

Acknowledge receipt of form. ^ 

Arrange and con duc^t co nference 
with teacher. (2 t 3] 



Arrange and c ojiduc 
conference. 



student 



Arr^ange and cq 
confer^n.ce. 




Arrange staffing/; consultation 
or data gatheri n^ ]iy other 
professionals. 



Ask appropriate parties to 
complete priori ty form. 

Summarize data on Case Report 
Summary One. 



DECISION AREA: 
QUESTIONS 



Problem Selection PROGRAM PHASE: Initial Assessment PROCESS: Mctisurement 



CO 



2. Is there a discrepancy 
between desi red and actual 
performance? 

" ^re, th^re desired academic 
progress expectations? 

f 

Are there desired Academic 
_ * performance, expectations? 

Are there desired expecta- 
. tions for social behavior? 

What is the target student's 
actual level of academic 
- progress? 

What is the target student* s 
_ actual level of academic 
performance? 

What is target student's 
performance in social * 
^' behavior? 

What is the discrepancy 
ratio? 



Is there data on past 
progress/performance? 



MATERIALS NEEDED 

Curriculum materials used in 
referred student's class. 

Procedures to collect data 

on des i red progress for average 

students, Q 

Procedures to collect data on 
desired performance for average 
students. (3) 

Procedures to collect data on 
social behavior of average 
studen ts. 

Procedures to collect data on 
actual academic progress of target 
student. 0 

Procedures to collect data on 
actua 1 acadji^mi 
student . 



ACTION REQUIRl!D 



Collect data on desired 
for average students. 



rogress 



Collect data on academic 
performance of average stu- 
-"dents. ' 

Collect baseline data on social 
behavior of average students. Q 



id err 



Collect baseline data on 
academic pejjjformance of target* 
student. 

_.. Collect basel ine' data on aca- 

icvperformance of target demic performance of target 

student. 



Procedures to collect data on 
social .behavior of target 
student, (s) 

Procedures to graph data on 
desired and actual progress/ 
performance. (5) 

Procedures to compute discrepancy 
ratios. ^ 

Cumulative folder data, (b) 



forme 

® 

set i 
den t ' : 



Collect baseline data on 
target studer^t's socia' 
behavior. 

Appropriately title and label 
graphs. Plot data on graphs. 

Compute discrepancy ratio an*^ 
record, on v;orksheet. ^) 

Summarize data pertinent to 
present priorities and 
problems. , 

Summarize data on Case Report 
Summary Two. (9) 



ENTRY LEVEL MASTERY 



DECISION AREA: Problem Selection PROGRAM PIIASR: Initial Assessment PROCHSS: Evaluation 
QUESTIONS 



3. Is the student eligible for 
service? 

Have impontant discrepancies 
been identified? 



Can a rationale be estab- 
lished for the importance 
of the problem? 

Does student meet eligi- 
bility requirements? 



the efjgi' 



MATERIALS NEEDED 

Guidelines for makin. 
bi 1 1 ty deci sion 

Procedures to review and evaluate 
data. (2) . . 



ACTION REQUIRED 



DECISION AREA: Program Selection PROGRAM PHASE: 

5. What program plans are, 
proposed? 



Review discrepancy data and 
. . select di screpancfes .which 

meet criterion ^ 

Write a rationale for the 
importance of che problem on« 
Case P-:port Summary Three. 

Convene staffing' to make^ 
el igibi 1 ity decision, 

Summarize decision on C^e 
• Report Summary Four. Q 

Program Planning. PROCESS: Evaluation 



For which* identified dis- 
crepancies wi 1 1 programs be 
' developed at this time? 

What program object ives are 
proposed for these behaviors? 
What progress/performance is 
estimated? How long an 
intervention is planned?"^ 

V, 

^ What program changes are 
proposed? • 

What resources are available 
to implement the plan? 



lect 

0 



Procedures to select discrepancies 
to be modi f led. 



Procedures to write objectives.^ 



ENTRY LEVEC ' MASTERY 



Guidelines for specifying program 
changes. ^ 

Suggested alternative administra** 
tive arrangements. 



Select discrepancies for v/hicS 
a program will developed on 
Case Repor^ Summary Five. 

Compute progress/performance , 
es t i mates ; 'iel ec t i n t erven t ion 
period; write long- and short-- 
term object ives , for each dis- 
crepancy on CaseReport Summaries 
Five and Six. 

Write at least tv/o program changes 
for each object; ive on Case. 
Report Summary Six. 

Propose 2 alternative arrange- 
ments to implement plan on Case 
Report Summary Seven, ^ 



DECISION" AREA: Program Selection PROGRAM PHASE: Program Planning PROCESS: >re^surement 



QiUESTIONS* 

.6. How will effectiveness^ 
of program plan be measured? 

Vhat procedures will be 
Jised to measure progress/ 
, performance' 



How often wi 1 1 
collected? 



data be 



MATERIALS NEEDED. 



Guidel f nes to selec 
ment procedures 



measure- 



ACTION REQUIRED 



Specify procedures to measure 
behaviors and frequency of data 
\c6l lection on Case Report 
Summary Ei^ht. fjj 



What progress/performance 
IS estfmated? x 



Procedures to draw projected 
progress/performance estimate 
on yraphs. 



Draw projected progress/ 
perfor?i\ance est imates on 
graphs. 



DECISION AREA: Program Selectioii PROGRiUI PHASE: Program Planning 
PROCESS: Communication and Collaboriution 

; 

Purpose ofprogram plan 
review.' Qj 



7." Does tf)% program plan 
meet ^he expressed needs of 
referrcr; student; parent; 
others? 



Have all parties been 
involved in pjanning? 

Have all parties accepted 
plan? ♦ 



Form Xo.recei,ve feedback on 
progrr^am plan, \(Qase Report 
Summary Nine) \2\ 



fiirotilate Case Report Summary 
Nine to interested parties. 

Arrange progcam'v^lan staffing 
if ceqgired. ^ ^ 




DECjlSION AREA: 

queLtions 



Pro;;rdm Operat ionalization 
■ PROCESS: 



PROGRAM PHASE: 
Measurement 



Is program being 
impjlemen ted as .planned? 

Are measurements being 
taken? Ar^ graphs being 
maintained for each' pin- 
pointed discrepancy? Are 
data being recorded as 
planned? a 

t 

f Are program changes being 
; made based on graphed 
j data? Are changes noted 
^ on graphs? 



MATERIALS NEEDED 



Guide) ines for implementTng 
data collection actjvities. ^ 



Decision rules for making program 
changes. (?) 



Implementation Evaluation 



ACTION REQUIRED 



Measure progress/performance. 
Plot data on graphs. 



■oqrc 



Make program changes based on 
data. 



DECISION AREA: Program Operat ionalization PROGRAM PHASE: Implementation Evaluation 

PROCESS:. Evaluation 



10,. Is program pi an 
as] proposed? 



implemented 



Are there a sufficient 
number of data points 
for each intervention? 

Are program changes fre- 
quent enough? 

Are changes made according 
to decision rules? 



Guidelines for reviewing data. Q 



Review graphed data and corrpare 
with program plan. Summarize 
results on Case Report Summary 
Ten. 0 



ENTRY LEVEL 



MASTERY 



ERLC 



DECISpN AREA: Program Operatioiuilization PROGRAM PHASE: rmplenv station Evaluation 
!■ ' PROCESS: Communication and Collaboration 



to 
o 



QUESTjIONS, • 

11. Are all parties aware of 
tne ektent to which the program 
is being implemented? 



MATERIALS NEEDED 

/ 

Purpose of periodic review 
meeting. 

Staffing Request Form. 



ACTION REQUIRED 



ENTRY LEVEL 



MASTERY 



Hold peF;j^6dic review meeting 
with team. 

Reconc i le -any differences be- 
tween program as planned 
I ^ and implemented. 

^ ! " Complete Parts Two and .Three of 

, 0 Case Report Summary Ten. ' 

I ■ I V I 

DECISION lAREA: Program Atljustment PROGRAM PHASE: Progress^^Evaluation PROCESS : Measurement 



13- Whatj information is avail- 
able or) cumulative/progress/ 
performance to date? 

What is me'iian level of 
progress/performance for 
each' change? 

Whatj is the discrepancy 
for each program change? 

What is the change in the 
- discrepancy ratio from 
initial assessment? 

What is the direction 
(trjind) of the data for 
eacn program change? 

Wha^t; variability is there 
in performance for each 
change? 

Is 'there a step (up or 
dovjn) at the point of 
change? 



GuiJeline<^ for obtaining 
change data. Qj 

Procedures to compute medians. 



Proceduresto compute discrepancy 
ratios. Q) 

Procedures .to compute change in 
discrepancy, ratios, (h^ 



Compute medians for each pro- 
gram change. 



Compute discrepancy ratios 



• © 



Compute cfynge in discrepancy 



ra 



mpute clwi 
ties. ^ 



as I to draw tre 
change. 



Procedures , to draw Lretid of data 
for each 



Draw trend 1 ines. 



Procedures to determine ^ 
variability and step changes, (s) 



Summarize variajjjlity and step 
change data. (6) 

Complete Part One of Case 
Report Summary Eleven. 
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DECISION AREA: Program Adjustment PROGRAM PHASE: Progress Evaluation PROCESS: Evaluation 



•QUESTIONS 

\k. Is the program as 
'implemented producing cumulative 
benefits for the student? 

' Are there positive data 
trends? 

Are there positive changes, 
in discrepancy ratios 
over Initial assessment? 

Were some program changes 
more effective than others? 

Will programs for other 
. behaviors identified as 
high priori ty during 
initial assessment be 
implemented at this time? 



MATERIALS NEEDED 



Practicein interpreting graphed 
data. 0 



ACTION REQUIRED 



Evaluate summarized program 
change data on discrepancy 
ratio worksheet and graphs. 
Complete Part Two of Case 
Report Summary Eleven. Qj 



Develop objectives and graphs 
for each new behavior. Select 
program changes for each objec- 
tive. Draw projected progress/ 
performance estimates on graphs. 
Circulate form to receive feed- 
back. (See Chapter VII.) 



ENTRY LEVEL 



MASTER? 



2m 



DECISION AREA: Program Adjustment PROGRAM PHASE: Progress Evaluation 
PROCESS: Communication and Collaboration 



QUESTIONS 

15* Can information gathered 
on program changes be useful 
to others? 



Are all interested parties 
informed of progress? 

Are there recommendations 
for program adj ustments?- 



MATERIALS. NEEDED 

Pyrpose of £eriodic review 
meet ihgs. 



Staffing Request Form. ^ 



DECISION AREA: Program Certification 

PROCESS : Measurement 



ACTION REQUIRED 

Summarize recommendations for 
further program improvement or 
Part Threeof Case Report Summary 
Eleven. 

Hold periodic review meeting 
with team, parent, student. 

Share data on student progress/ 
'performance with team, parent, 
, student. Discuss recommendations 

for further program improvement. 
Complete Case Report Summary 
Eleven. (?) 

Continue program as recommended. 
Repeat review-.process at regular 
intervals. 

PROGRAM PHASE: Outcome Evaluation 



17. What are present progress/ 
performance discrepancies? 

What are present discrep- 
ancy ratios for all be- 
haviors during the program? 

What Is the present trend 
•of the data? 



Collecting summary data for the 
program certification decision. 

0 



Summarize data'on the discrepancy 
ratio worksheet. Draw trend 
lines. Complete Part One of 
Case Report Summary Twelve. 



ENTRY LEVEL 



MASTERY 




< ) 
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DECISION AREA: Program Certification PROGRAM PHASE: Outcome Evaluation PROCESS: Evaluation 



^QUESTIONS 

18. Should the program as 
presently planned and implement- 
ed be terminated/ 

Has program been success- 
ful in reducing the dis- 
' crepancies?^ 

Can others assume res- 
ponsibility for this stu- 
dent's program without 
assistance from Special 
•'•"Education personnel? 



MATERIALS NEEDED 

Guidelines for prjjgram certifica- 
tion decision. Ill 



ACTION REQUIRED 



Review Summary data. Summarize 
and make recommendation on Part 
Two of Case Report Summary 
Twelve, (z) 



ENTRY LEVEL 



MASTERY 



DECISION AREA: Program Certification PROGRAM PHASE: Outcome Evaluation 
PROCESS: Communication and Collaboration 



19. Has program been success- 
ful in satisfying the needs 
of all interested parties. 

Are all concerned persons 
aware of program out- 
comes? Are a 1 1 sat- 
. isfied? 



Program certification review 
procedures. Mj 

Staffing Request Form. 



Hold program certification 
review with team, parents, 
student. Hake program 
certification decision. Summarize 
results on Part Three of Case 
Report Summary Twelve. 



ERIC 



1a) 



QUESTIONS 
DECISION. AREA: 



PROCESS: Consultation and Training 
• MATERIALS NEEDED ACTION REQUIRED 

Problem Selection PROGRAM PHASE: Intake Assessment 



k. Can the SERT help or train others 
to select problems for program modifi- 
cation? 



See Chapters IV, V, 
and VI, 



Are therfe other persons who can be 
,hejped or trained to collect dis- 
crepancy Jata, conduct interviews, and 
• establish priori^ties and eligibility 
.for service? * 

DECISION AREA: Program Selection PROGRiXM PHASE: Program Planning 

8. Can the SERT help or train others to See Chapter VM. 
select programs? 



Consult with or train others" (aides, 
regular class teachers) to coHect 
discrepancy dat^. conduct. Jjiterr 



views, and establish priorities and 
eligibility for service. 



Are there other persons Vho can be 
.helped pr trained to propos% alter- 
native programs, write objectives, 
determine measurement procedures? 



Consult with or train others to propose 
alternative programs, write objectives, 
and determine measurement proceduresV 



DECISION AREA: Program Operat ion^lizat ion PROGRAM PHASE: Implementation Evaluation 



.12, Can the SERT help or train others 
to opera t ional fze program plan? 

. .Are there other persons who can be 
helped or trained to implement pro- 
grams, measure performance^ and eval- 

, uate extent to which program plan 
is being implemented as proposed? 

DECISION AREA: Program Improvement 

16' Can the SERT help or train others 
, to improve prx)grams? 

Are* there other persons who can be 
' helped or trained to evaluate pro- 
gress, propose program changes, and 
r adjust programs? 



See Chapter VI I.I' 



Consult with or train others to imple- 
ment, measure, and evaluate program. 



PROGRAM PHASE: Progress Evaluation 
See Chapter IX. 



Consult with or train others to evaluate 
progress and "make ro .ommecwiations for 
further program mod- Tication. 



DECISION AREA: Program Certification PROGRAM PHASE: Outcome Evaluation 



20. Can the. SERT help or train others 
to certify prograrfcs? 

Are there other persons who can be 
^i^y helped or trained to evaluate 

^whether program should be * 
hKJC te;rminated?^ 



See Chapter X 



ConsuTt with or train others to evaluate 
program outcomes and determine 
whether program should be terminated. 
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' CASE REPORT SUMMARY ONE 



Grade 




□ 



Age 



Student 
I. PROBLEM SELECTION 



1 . Who owns the problem? - 

Are the problems thoser. that/tfeacher/parent/student/others identify? 
\ What are the priorities? 

Summarize^ i nterview data here. 
' Are the problem^ those the teacher identifies? 



Teacher 



Ar^ the problems those the parent identifies? 



Are the problems those the student identifies? 



Other Comments: 



Summarize the priority rankings here. 



u 
o 

> 

f 





TEACHER 


^ PARENT 


, STUDENT 


OTHERS" 


MEDIAN OR AVERAGE 































































*These are 'different for each student. 



2^ f ' 
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CASE REPORT SUMMARY TWO 



Student 



Grade 



Age 



Teacher 



2* Is there a discrepancy between desired and actual pr rformances? 
What are the discrepancy ratios for high priority benaviors? 
What. data are avai 1 able on past history of progress/performance? 



List the priority behaviors and discrepancies here," 



BEHAVIOR 














DISCREPANCY 




















BEHAVIOR 














DISCREPANCY 















Summarize appropriate data from cumulative fi'le here. 



0 



2A9 i 



CASE REPORT SUMMARY THREE 



Student 



Grade 



Age 



Teacher 



3. Is the student eligible for service ? 

Have Impo tant discrepancies been identified? 

Can a rationale be es tab! i shed" for the importance of the problem?. 
Write a rationale for the importance of the problem herel 



Dat,e Completed ^ 

By 



♦) / 



CASE REPORT SUMMARY FOUR- 



Student 



Grade 



Age 



3. Is the student eligible for service? 
Does the student meet established ell 



(cont . ) 
gibility requirements? 



Summarize the results of the staffing here. 



Date Completed 
By ' 



Participants 



CASE REPORT SUMMARY FIVE 



Student Grade Age TeacheP 

IL PRO&RAM PLANNING. ' 
* 5. What program pians are' proposed ? . 

For which identified discrepancies will program plans be developed 
at this time? 

What progress/performance is needed to reduce the discrepancies? 
List discrepaitcies for which program modifications will be developed. 



Summarize estimates of progress/performance needed to reduce the discrepancies here. 
TIME 



CASE REPORT SUMMARY SIX 



Student 



Grade 



□ 

Age 



Teacher 



5. What program plans are proposed? (cont.) 

What program objectives are proposed? ^ 
. What program changes, are proposed? 

» ■> ' ' 

List long-ran^e^ weekly, daily objectives and program changes for each program 
modi fi cat Ton Here; 

CONDITIOr^ BEHAVIOR - ^ 



CRITERIA 



Long 
Range 



Behavior 

. Daily 
or 
Weekl y 

Behavior 



Lcng 
Range 



Behavior 

Daily 
or 
Week I y 

Behavior 



Long 
Range 



Behavior 

Dai 1y 
or 
Weej< I y 

Behavior 



Change 1 
Change 2 
Change 3 



CONDITIONS 



Change I 
Change 2 
Change 3 



CONDITIONS 



Change 1 
Change 2 
Change 3 



BEHAVIOR 



CRITERIA 



BEHAVIOR 



CRITERIA 




; CASE REPORT SUMMARY SEVEN 



Student Grade Age ' Teacher 

5. What program plans are proposed? (cont.) 

What resources are available to implement the plan? 

Propose several possible program arrangements here. <> 



Beha^/ior 


Program 
Arrangement 


Type of instruction 


Time 


Implementor 


Place 




\ 


Direct Group 
Indirect Individual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


Resource Room 

Classroom 

Other 


- 


2 


Direct Group 
Indirect Individual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


Resource Room 

Classroom 

Other 




1 


Direct Group 

1 nd 1 rect 1 nd i vi dual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


"Resource Room 
CI ass room 
Other 


"1 


2 


Di rect Group 
Indi rect Individual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


RescJtirce Room 

Classroom 

Other 


0 


1 


Direct Group 
Indirect Individual 




SERT AIDE 
CLASS TEACHER OTHER 
PEER 


Resource Room 

Classroom 

Ot,her 


1 


2 

L 


Direct Group 
Indi rect Individual 


ft 


SERT AIDE 
CLASS TEACHER OTHER 
PEER 


Resource Room 
C I ass room 
Other 



Date Completed 



CASE REPORT SUMMARY E-IGHT 



Student Grade Age Teacher 

6 . How will effectiveness of the program pian be measurt^d? 
What graphs will be maint.iined for the program? 
ow often will data be collected? 



Behavior 
to be 
moasurvid 


How materials 
are organized 


What fhe 
teacher says 


What the 
student 
doe s. 


Type of 
graph 


Frequency of- 
measurement 


What is 
recorded on 
on- graph 










Progress 

i 

Performance 


Da i 1 y 

Weekly 

Monthly 












Progress 
Performance 


Dai 1y 
Weekl y 
Monthly o 












Progress 
Performance 


Oai ly 
Week 1 y 
Monthl y 





This case report sunfimary is an adaptation of a recording format presented^by J. E. McCormack, Jr. 
in The assessment tool that meets your needs: The one you construct. Teachin^'^ Lxcep^^tional ' 
Children, 1976, 8(3'), IO6-IO9. 



CASE REPORT SUMMARY NINE 



Student 



Grade 



Age 



Teacher 



7.. Does the program plan meet the expressed needs of the referrer? 
student? parent? others ? 

Have oil parties been involved in plannin9? 
Kave all parties accepted plan? - '^y^ 

Pi rect ions : 

Circulate proposed plans (Case Report Summaries Five, Six, Seven, and Eight) to interested 
parties and solicit their fjrogram plan preferences on the form below. 1 



Enclosed are the plans which have been proposed for. 



program. Please 



read them and indicate your approval or disapproval of the plah and your clioice of administrative 
arrangement. If you have concerns about the plan which nesfd to be communicated in person, please 
stOB in to see me in the resource room any mornir.i^ before the start of school or call me at 
. If plans are not satisfactory a team meeting will be arranged. 



SERT 



Date 



*l have read the enclosed plans. 
My preference is as follows: 



Preferences 



Behavior 


Program Arrangement 


Class Teacher 


Parent 


student 


Other Team Members 




1. 








o 




2. 












1. 












2. 








c 




1. 












2. 










ACCEPT 


PROGRAM OBJECTIVES 










REJECT 


AND CHANGES 











Please return to the SERT's mailbox as soon as possibla so that the program may begin. 

Program Plan: Accepted 

Date 



To meet requirements of P.L. 9^-1^2 a staffing may be necessary here. 



CASE REPORT SUMMARY TEN 



Student Grade 
Ml. PROGRAM OPERAT'.ONALIZATION 



Age 



Teacher ' 



9- Is program bejng implemented? 
10. is program beang implemented as. proposed? 

\ 1 . Are all parties aware of the extent to v/hich the program Is being 
implemented as planned? 

Summarize <iata from graphs here. 



Date , ' . * 


I4u:nber of Graphs 


1 2 3 


i» 5 6 




Da^a Plotted? 


' /ES/ 


NO 




Changes Made? 


YES/ 


NO 




Are changes 
frequent enough? 


9e$/ 


NO 


Comment 



Summarize review nrieeting here. 



Date 



List, changes i p^l , * red to reduce discrepancy between program plan and program^ implementation 



Date 



2b4 



OASE REPORT SUMMAkY ELFVEN 



Student Grade • Age Teacher- 

IV. PROGRAM IMPROVEMENT 

1 3- What ioformjation is available on cumulative progress/performance to date? 
What data are available for each program change ? 

What is the change in the discepancy ratio fronrr initial assessment? 
Have programs been developed * ' nee the last periodic review? 

Summarize data over program changes here. List behavior new sinc-e last periodic review. 



Behavior 


Trend 


Level 


Variabi 1 i ty 


Step at 
Jntervention 




Pos i t lye 
Nega t i ve 


1 ncrease 
Decrease 




Up 

Down 
None 




Posi t ive 
Nega ti ve 


Increase 
Decrease 




Up 
' Down 
None 




Pos i t ive 
Nega t ive 


Increase 
Decrease 




Up 

Down 
None 




Pos i t i VG 
Negative 


Increase 
Decrease 




Up 

Down 
None 




Pos i t ive 
Nega t ive 


^ Increase ' . 
Decrease 




Up 

Down 
None 



Is the program as implemented jSroducing cumulative benefits for the student? 

Are there positive changes in the 'discrepancy ratio ? 

Were some changes more effect iver than others? ' * 



Behavior 


Changes which were most effective 


















> 




. 15. 


Can information gathered on program changes be useful to others? 

Are all interested parties informed of progress? 

Are ^here recommendations for future program modifications? 


^Behavior 


Recommendations for changes Review Date _ 








o 














Present: 
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CASE REPORT SUMKARY TWELVE 



Student 



Grade 



Age 




1 7« What are' the present progress/performance discrepancies? 

What are the present discrepancy ratios, for all behaviors modified 

during that program ? 

What are the present data trends? 



behavior\^ 


Present Discrepancy 
Date 


- — ^ 

Change Over Initial Assessment 


Trend • 


READING PROGRESS^ 








- MATH PR9GRESS 








- SPELLING . * 








. NOISE 









18. Should the program as presently planned and implemented be terminated? 

Has program been successful in reducing discrepancies? 1 
Can others assume respons ibi 1? ty for this students program \Vi thout assistance 
from Speeial Edycation ? ^ 

Summarize data review and recommendations here. 



19. Has program -be^n successful in satisfying needs of all interested partlesZ 
Are all parties aware of program outcomes? ^ , 

Are al 1 satisfied ? ^ - / • " 

Summarize results of staffing here 











t' 






• 








f ' t 












,* '/ 


Date Completed 




. Present 








Cont inue 


Di rect 












Indirect 












Terminate 



1 



If decision matrix, is used place matrix 



4 
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.APPEND.IX C 
.Change Strategics 





■■// 



Chaiyge Strategies 



TO 

2* ' Foientiat BeinfovQevd 

, a# Socia 1 / ^ 

-Praise (verbal ^ \ 
-Praise (peer) ^ 
. -Praise (projeo't posted) 
. -Peer tutor / 
^Attend to- ch:i/ld 
. -Teacher addresses student 
-Peer cc-worK^r 
-Working with a friend 
-Positive note .home 
-Positive teflephone contact 
.-Special • responsibi 1 i ties at school 
-Pick a friend to do 'something with 
* ^ ^ -Share results of graphing with 
chi Id every day ^ / 

-Tell student you '^missed" him in 

special /way 
-Talk w'i" someone of her/his choice 

, ^ b. Activi 




d. 



BEHAVIOR . _ 

"^Potential Prompts 

a. Verbal ' 

-Prepare individual cards with rules 
-Ask aider child or peer who knows ^ 
alphabet to practice with child 
/ -Talk about story in class > } 

j -Suggest Specific topic to write abodt 
• ' -Topic cards to choose from 
j -Suggest specific nouns to inC"lude / 
; ' -Suggest speci fic* verbs to include'^/ , 

-Suggest specific adjectives to include 
/ -Provide single sound auditory cue. for 
word identification , / 

j -Make contract with con t ingencies /stated 
/ -Call student at home when absent'^ 



/ 



-Make own book . ' 
-Use typewriter 

-Free tin;e to do preferred activity 

-Early dismissal ^ 

-Be teacKer and plan lesson 

-Go to media center 

-Spend time in library 

-Clean animal cage' 

-Do favorite school work 

-Havb child graph oral reading 

rates * 
-Have' teacher graph performance 
-M^Ke graph for child to use to ' 

graph performance 
-Take a fiield trip 
-Use tapei recorder, film strips, 

record player, other audio visual 
' material 

-Be offi,ce assistant 

-Be 'cross- age tutor 

-Activity period of his/her choice 

' Concrete i . 
-Stars and stickers 
'-Candy I , 
-Money/ , / 

^cPencils, /tablets, erasers^stationery^ 
papeT^cUpji^ 

Indirect^" ^ ^ "r - 



-Points, tokens chips, washers, check-, 
marks, test scores, which can be 
exchanged for other reinforcers 
at a more appropriate time 



b. - Nonverbal 

-Look up answers on tables, matV^tx, 
-Write down boritowed or carried numbers 
-Have child copy the letters as^he says * 

them ' ' , / 

-Have t;he child trace the letters, as he 
- says them 
J-Use a stimulus picture for story telling 
^r-Chip trading ^ ! ' . 

, -Concrete cues, blocks^ i:hips/, marbles, 
' r etc- " 5 / 

/ -Use multi-based blocks / 
-Time interval chart on desk'; checks 
given ^ery 5-10-15 min. for sitting 
^^stMl^ - ^ / 

-Have student self- chart # /of positive. 

peer contacts; positive feelings. 
-Have teacher or observer ^chart out-of- 
seat behavior and share the results with 
chi Id every day j 
* -Set time^ for varied intervals 

c. Model ing , 

^ .-Practice saying words o^ Language Master 
-Seati/ng arranged to be surrounded 

by quiet students / 
-Echoic reading " / 

-Copy spelling wtfrds from list 
-Copy, correct letters ahd numerals from 

list . ^ / I . 

a. Shifting criterion / j 

-Reinforce for successive approximations 

to 100% ' . I I 

-Increase criteria for mastery jdd i ly/ 
,Weekly , / ' 

-Require gradual smppvement in on-task 
behavior t 
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-Reinforce' for increasing! / larger amounts 
of work 

-Reward for increasing # min. in school, 
etc. 

,-Sbape behavior by enforcing short inter- 
vals of appropriate b,ehavior and then 
increase length of time required for 
reinforcer ' , ' 



Chaining (task analysis) 
-Teach phonics 

-Pinpointing s.l icing (practice on 
smal ler set) • , . 

-Work on simpler math operations i 
fore complex 

-Work on spelling similar words 



'?otentiat Time-Oub 



I 



TO DECREASE 

' 2: 



"^Remove opportunity to earn indirect 

reinforcers for 5 minutes 
-Remove opportunity for social interaction 

for 5 minutes 
-Remove opportunity to engage in preferred 

activities for 5 minutes 



BEHAVIOR 

Potential Response Coat - ^ • 
-Fines 

-Take awcy indirect, concrete, social rein 
forcers, or activity (tv, car, friehds, et' 

Other Potential Pimishev^ 

-Error correction . ' 

-Graph of error performance 

-Sharing graphs of undesirable behavior 

-Sad faces 

-Red. checkmarks 



/ 



/ 

/ 
/ 
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